2025-04-02 03:01:36,518 [ 335101 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2025-04-02 03:01:36,519 [ 335101 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:97, check_args_and_update_paths) 2025-04-02 03:01:36,519 [ 335101 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:108, check_args_and_update_paths) 2025-04-02 03:01:36,519 [ 335101 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:110, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_esx477 --privileged --dns-search='.' --memory=30709035008 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=8b2301119731 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS=" -rfEps --run-id=1 --color=no --durations=0 'test_storage_delta/test.py::test_checkpoint[0]' 'test_storage_delta/test.py::test_checkpoint[1]' 'test_storage_delta/test.py::test_complex_types[0]' 'test_storage_delta/test.py::test_complex_types[1]' 'test_storage_delta/test.py::test_filesystem_cache[0-s3]' 'test_storage_delta/test.py::test_filesystem_cache[1-s3]' 'test_storage_delta/test.py::test_metadata[0]' 'test_storage_delta/test.py::test_metadata[1]' 'test_storage_delta/test.py::test_multiple_log_files[0]' 'test_storage_delta/test.py::test_multiple_log_files[1]' 'test_storage_delta/test.py::test_partition_by[0]' 'test_storage_delta/test.py::test_partition_by[1]' 'test_storage_delta/test.py::test_partition_columns[0]' 'test_storage_delta/test.py::test_partition_columns[1]' 'test_storage_delta/test.py::test_replicated_database_and_unavailable_s3[0]' 'test_storage_delta/test.py::test_replicated_database_and_unavailable_s3[1]' 'test_storage_delta/test.py::test_restart_broken[0]' 'test_storage_delta/test.py::test_restart_broken[1]' 'test_storage_delta/test.py::test_restart_broken_table_function[0]' 'test_storage_delta/test.py::test_restart_broken_table_function[1]' 'test_storage_delta/test.py::test_single_log_file[0]' 'test_storage_delta/test.py::test_single_log_file[1]' 'test_storage_delta/test.py::test_types[0]' 'test_storage_delta/test.py::test_types[1]' test_storage_rabbitmq/test.py::test_rabbitmq_sharding_between_queues_publish -vvv -ss" altinityinfra/integration-tests-runner:2165613c5fcd '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket= rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: timeout-2.3.1, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0, random-order-1.1.1 timeout: 900.0s timeout method: signal timeout func_only: False collecting ... collected 25 items test_storage_delta/test.py::test_checkpoint[0] Picked up JAVA_TOOL_OPTIONS: -Djdk.attach.allowAttachSelf=true Picked up JAVA_TOOL_OPTIONS: -Djdk.attach.allowAttachSelf=true Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 25/04/02 03:01:44 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml 25/04/02 03:02:13 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:13 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:13 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:13 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 0:> (0 + 1) / 1] 25/04/02 03:02:15 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:15 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 1:> (0 + 1) / 1] 25/04/02 03:02:19 WARN package: Truncated the string representation of a plan since it was too large. This behavior can be adjusted by setting 'spark.sql.debug.maxToStringFields'. [Stage 5:=> (1 + 1) / 50] [Stage 5:==> (2 + 1) / 50] [Stage 5:====> (4 + 1) / 50] [Stage 5:========> (7 + 1) / 50] [Stage 5:==========> (9 + 1) / 50] [Stage 5:=============> (12 + 1) / 50] [Stage 5:=================> (15 + 1) / 50] [Stage 5:=====================> (19 + 1) / 50] [Stage 5:==========================> (23 + 1) / 50] [Stage 5:==============================> (27 + 1) / 50] [Stage 5:===================================> (31 + 1) / 50] [Stage 5:======================================> (34 + 1) / 50] [Stage 5:==========================================> (37 + 1) / 50] [Stage 5:===============================================> (42 + 1) / 50] [Stage 5:====================================================> (46 + 1) / 50] 25/04/02 03:02:24 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:24 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:24 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:24 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:24 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:24 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 14:===========> (10 + 1) / 50] [Stage 14:================> (15 + 1) / 50] [Stage 14:=====================> (19 + 1) / 50] [Stage 14:=========================> (23 + 1) / 50] [Stage 14:=============================> (26 + 1) / 50] [Stage 14:================================> (29 + 1) / 50] [Stage 14:===================================> (32 + 1) / 50] [Stage 14:========================================> (36 + 1) / 50] [Stage 14:===========================================> (39 + 1) / 50] [Stage 14:=================================================> (44 + 1) / 50] [Stage 14:======================================================> (49 + 1) / 50] 25/04/02 03:02:28 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:28 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:28 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:28 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:29 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:29 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 23:==========> (9 + 1) / 50] [Stage 23:=============> (12 + 1) / 50] [Stage 23:=================> (16 + 1) / 50] [Stage 23:=====================> (19 + 1) / 50] [Stage 23:=========================> (23 + 1) / 50] [Stage 23:=============================> (26 + 1) / 50] [Stage 23:=================================> (30 + 1) / 50] [Stage 23:=======================================> (35 + 1) / 50] [Stage 23:============================================> (40 + 1) / 50] [Stage 23:=================================================> (44 + 1) / 50] [Stage 23:======================================================> (49 + 1) / 50] 25/04/02 03:02:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 32:==============> (13 + 1) / 50] [Stage 32:===================> (17 + 1) / 50] [Stage 32:========================> (22 + 1) / 50] [Stage 32:=============================> (26 + 1) / 50] [Stage 32:==================================> (31 + 1) / 50] [Stage 32:========================================> (36 + 1) / 50] [Stage 32:=============================================> (41 + 1) / 50] [Stage 32:==================================================> (45 + 1) / 50] 25/04/02 03:02:36 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:36 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:36 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:36 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:36 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:36 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 41:================> (15 + 1) / 50] [Stage 41:======================> (20 + 1) / 50] [Stage 41:==========================> (24 + 1) / 50] [Stage 41:=================================> (30 + 1) / 50] [Stage 41:======================================> (34 + 1) / 50] [Stage 41:===========================================> (39 + 1) / 50] [Stage 41:================================================> (43 + 1) / 50] [Stage 41:======================================================> (49 + 1) / 50] 25/04/02 03:02:39 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:39 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:39 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:39 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:39 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:39 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 50:================> (15 + 1) / 50] [Stage 50:======================> (20 + 1) / 50] [Stage 50:============================> (25 + 1) / 50] [Stage 50:=================================> (30 + 1) / 50] [Stage 50:========================================> (36 + 1) / 50] [Stage 50:===============================================> (42 + 1) / 50] [Stage 50:=====================================================> (48 + 1) / 50] 25/04/02 03:02:42 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:42 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:42 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:42 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:42 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:42 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 59:==============> (13 + 1) / 50] [Stage 59:=====================> (19 + 1) / 50] [Stage 59:==========================> (24 + 1) / 50] [Stage 59:===============================> (28 + 1) / 50] [Stage 59:====================================> (33 + 1) / 50] [Stage 59:===========================================> (39 + 1) / 50] [Stage 59:==================================================> (45 + 1) / 50] 25/04/02 03:02:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 68:==============> (13 + 1) / 50] [Stage 68:=====================> (19 + 1) / 50] [Stage 68:==========================> (24 + 1) / 50] [Stage 68:=================================> (30 + 1) / 50] [Stage 68:========================================> (36 + 1) / 50] [Stage 68:=============================================> (41 + 1) / 50] [Stage 68:====================================================> (47 + 1) / 50] 25/04/02 03:02:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 77:===================> (17 + 1) / 50] [Stage 77:=========================> (23 + 1) / 50] [Stage 77:================================> (29 + 1) / 50] [Stage 77:======================================> (34 + 1) / 50] [Stage 77:============================================> (40 + 1) / 50] [Stage 77:==================================================> (45 + 1) / 50] 25/04/02 03:02:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 86:================> (15 + 1) / 50] [Stage 86:=======================> (21 + 1) / 50] [Stage 86:=============================> (26 + 1) / 50] [Stage 86:==================================> (31 + 1) / 50] [Stage 86:=======================================> (35 + 1) / 50] [Stage 86:==========================================> (38 + 1) / 50] [Stage 86:=============================================> (41 + 1) / 50] [Stage 86:===================================================> (46 + 2) / 50] 25/04/02 03:02:55 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:55 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:55 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:55 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:55 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:55 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 95:================> (15 + 1) / 50] [Stage 95:======================> (20 + 1) / 50] [Stage 95:============================> (25 + 1) / 50] [Stage 95:================================> (29 + 1) / 50] [Stage 95:=======================================> (35 + 1) / 50] [Stage 95:============================================> (40 + 1) / 50] [Stage 95:==================================================> (45 + 1) / 50] [Stage 95:======================================================> (49 + 1) / 50] 25/04/02 03:02:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:02:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 110:===========> (10 + 1) / 50] [Stage 110:=================> (16 + 1) / 50] [Stage 110:========================> (22 + 1) / 50] [Stage 110:=============================> (27 + 1) / 50] [Stage 110:===================================> (32 + 1) / 50] [Stage 110:========================================> (37 + 1) / 50] [Stage 110:=============================================> (41 + 1) / 50] [Stage 110:===================================================> (47 + 1) / 50] 25/04/02 03:03:03 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:03 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:03 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:03 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:03 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:03 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 119:=============> (12 + 1) / 50] [Stage 119:=================> (16 + 1) / 50] [Stage 119:========================> (22 + 1) / 50] [Stage 119:==============================> (28 + 1) / 50] [Stage 119:====================================> (33 + 1) / 50] [Stage 119:=========================================> (38 + 1) / 50] [Stage 119:===============================================> (43 + 1) / 50] 25/04/02 03:03:06 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:06 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:06 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:06 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:06 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:06 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 128:=============> (12 + 1) / 50] [Stage 128:===================> (18 + 1) / 50] [Stage 128:==========================> (24 + 1) / 50] [Stage 128:===============================> (29 + 1) / 50] [Stage 128:======================================> (35 + 1) / 50] [Stage 128:=============================================> (41 + 1) / 50] [Stage 128:===================================================> (47 + 1) / 50] 25/04/02 03:03:09 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:09 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:09 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:09 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:09 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:09 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 137:================> (15 + 1) / 50] [Stage 137:======================> (20 + 1) / 50] [Stage 137:============================> (26 + 1) / 50] [Stage 137:===================================> (32 + 1) / 50] [Stage 137:=========================================> (38 + 1) / 50] [Stage 137:=================================================> (45 + 1) / 50] 25/04/02 03:03:12 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:12 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:12 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:12 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:12 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:12 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 146:=================> (16 + 1) / 50] [Stage 146:========================> (22 + 1) / 50] [Stage 146:==============================> (28 + 1) / 50] [Stage 146:=====================================> (34 + 1) / 50] [Stage 146:=============================================> (41 + 1) / 50] [Stage 146:===================================================> (47 + 1) / 50] 25/04/02 03:03:15 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:15 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:15 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:15 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:15 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:15 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 155:============> (11 + 1) / 50] [Stage 155:=================> (16 + 1) / 50] [Stage 155:========================> (22 + 1) / 50] [Stage 155:=============================> (27 + 1) / 50] [Stage 155:==================================> (31 + 1) / 50] [Stage 155:========================================> (37 + 1) / 50] [Stage 155:==============================================> (42 + 1) / 50] [Stage 155:=====================================================> (49 + 1) / 50] 25/04/02 03:03:18 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:18 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:18 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:18 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:18 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:18 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 164:===================> (18 + 1) / 50] [Stage 164:==========================> (24 + 1) / 50] [Stage 164:=================================> (30 + 1) / 50] [Stage 164:=======================================> (36 + 1) / 50] [Stage 164:==============================================> (42 + 1) / 50] [Stage 164:==================================================> (46 + 1) / 50] 25/04/02 03:03:21 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:21 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:21 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:21 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:21 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:21 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 173:==============> (13 + 1) / 50] [Stage 173:====================> (19 + 1) / 50] [Stage 173:===========================> (25 + 2) / 50] [Stage 173:===================================> (32 + 1) / 50] [Stage 173:=========================================> (38 + 2) / 50] [Stage 173:=================================================> (45 + 1) / 50] 25/04/02 03:03:24 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:24 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:24 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:24 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:24 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:24 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 182:===================> (18 + 1) / 50] [Stage 182:==========================> (24 + 1) / 50] [Stage 182:=================================> (30 + 1) / 50] [Stage 182:=====================================> (34 + 1) / 50] [Stage 182:========================================> (37 + 1) / 50] [Stage 182:=============================================> (41 + 1) / 50] [Stage 182:==================================================> (46 + 1) / 50] 25/04/02 03:03:27 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:27 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:27 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:27 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:27 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:27 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 191:========> (8 + 1) / 50] [Stage 191:=============> (12 + 1) / 50] [Stage 191:=================> (16 + 1) / 50] [Stage 191:=======================> (21 + 1) / 50] [Stage 191:==========================> (24 + 1) / 50] [Stage 191:==============================> (28 + 1) / 50] [Stage 191:===================================> (32 + 1) / 50] [Stage 191:======================================> (35 + 1) / 50] [Stage 191:==========================================> (39 + 1) / 50] [Stage 191:===============================================> (43 + 1) / 50] [Stage 191:===================================================> (47 + 1) / 50] 25/04/02 03:03:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 206:================> (15 + 1) / 50] [Stage 206:=======================> (21 + 1) / 50] [Stage 206:==============================> (28 + 1) / 50] [Stage 206:=====================================> (34 + 1) / 50] [Stage 206:============================================> (40 + 1) / 50] [Stage 206:===================================================> (47 + 1) / 50] 25/04/02 03:03:35 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:35 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:35 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:35 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:35 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:35 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 215:===============> (14 + 1) / 50] [Stage 215:====================> (19 + 1) / 50] [Stage 215:===========================> (25 + 1) / 50] [Stage 215:==================================> (31 + 1) / 50] [Stage 215:=======================================> (36 + 1) / 50] [Stage 215:============================================> (40 + 1) / 50] [Stage 215:===============================================> (43 + 1) / 50] [Stage 215:===================================================> (47 + 1) / 50] 25/04/02 03:03:38 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:38 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:38 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:38 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:38 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:38 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 224:==============> (13 + 1) / 50] [Stage 224:====================> (19 + 1) / 50] [Stage 224:========================> (22 + 1) / 50] [Stage 224:===============================> (29 + 1) / 50] [Stage 224:=====================================> (34 + 1) / 50] [Stage 224:=============================================> (41 + 1) / 50] [Stage 224:===================================================> (47 + 1) / 50] 25/04/02 03:03:41 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:41 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:41 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:41 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:41 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:41 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 233:===============> (14 + 1) / 50] [Stage 233:===================> (18 + 1) / 50] [Stage 233:==========================> (24 + 1) / 50] [Stage 233:=================================> (30 + 1) / 50] [Stage 233:=====================================> (34 + 1) / 50] [Stage 233:============================================> (40 + 1) / 50] [Stage 233:==================================================> (46 + 1) / 50] {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None FAILED test_storage_delta/test.py::test_checkpoint[1] 25/04/02 03:03:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:45 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 242:==============> (13 + 1) / 50] [Stage 242:==================> (17 + 1) / 50] [Stage 242:========================> (22 + 1) / 50] [Stage 242:==============================> (28 + 1) / 50] [Stage 242:===================================> (32 + 1) / 50] [Stage 242:=======================================> (36 + 1) / 50] [Stage 242:============================================> (40 + 1) / 50] [Stage 242:================================================> (44 + 1) / 50] 25/04/02 03:03:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 251:===============> (14 + 1) / 50] [Stage 251:======================> (20 + 1) / 50] [Stage 251:============================> (26 + 1) / 50] [Stage 251:===================================> (32 + 1) / 50] [Stage 251:=========================================> (38 + 1) / 50] [Stage 251:================================================> (44 + 1) / 50] 25/04/02 03:03:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 260:================> (15 + 1) / 50] [Stage 260:=======================> (21 + 1) / 50] [Stage 260:============================> (26 + 1) / 50] [Stage 260:===================================> (32 + 1) / 50] [Stage 260:=========================================> (38 + 1) / 50] [Stage 260:================================================> (44 + 1) / 50] 25/04/02 03:03:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 269:=================> (16 + 1) / 50] [Stage 269:======================> (20 + 1) / 50] [Stage 269:============================> (26 + 1) / 50] [Stage 269:===================================> (32 + 1) / 50] [Stage 269:=========================================> (38 + 1) / 50] [Stage 269:================================================> (44 + 1) / 50] 25/04/02 03:03:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 278:==================> (17 + 1) / 50] [Stage 278:=========================> (23 + 1) / 50] [Stage 278:===============================> (29 + 1) / 50] [Stage 278:=======================================> (36 + 1) / 50] [Stage 278:=============================================> (41 + 1) / 50] [Stage 278:==================================================> (46 + 1) / 50] 25/04/02 03:03:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:03:59 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 287:==============> (13 + 1) / 50] [Stage 287:====================> (19 + 1) / 50] [Stage 287:===========================> (25 + 1) / 50] [Stage 287:==================================> (31 + 1) / 50] [Stage 287:=======================================> (36 + 1) / 50] [Stage 287:==============================================> (42 + 1) / 50] [Stage 287:==================================================> (46 + 1) / 50] 25/04/02 03:04:02 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:02 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:02 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:02 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:02 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:02 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 296:===============> (14 + 1) / 50] [Stage 296:====================> (19 + 1) / 50] [Stage 296:============================> (26 + 1) / 50] [Stage 296:=================================> (30 + 1) / 50] [Stage 296:======================================> (35 + 1) / 50] [Stage 296:==============================================> (42 + 1) / 50] [Stage 296:===================================================> (47 + 1) / 50] 25/04/02 03:04:04 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:04 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:04 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:04 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:05 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:05 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 305:===================> (18 + 1) / 50] [Stage 305:==========================> (24 + 1) / 50] [Stage 305:==================================> (31 + 1) / 50] [Stage 305:========================================> (37 + 1) / 50] [Stage 305:===============================================> (43 + 1) / 50] [Stage 305:=====================================================> (49 + 1) / 50] 25/04/02 03:04:07 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:07 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:07 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:07 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:07 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:07 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 314:===============> (14 + 1) / 50] [Stage 314:====================> (19 + 1) / 50] [Stage 314:==========================> (24 + 1) / 50] [Stage 314:==============================> (28 + 1) / 50] [Stage 314:=====================================> (34 + 1) / 50] [Stage 314:============================================> (40 + 1) / 50] [Stage 314:==================================================> (46 + 1) / 50] 25/04/02 03:04:10 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:10 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:10 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:10 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:10 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:10 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 323:=============> (12 + 1) / 50] [Stage 323:===================> (18 + 1) / 50] [Stage 323:=========================> (23 + 1) / 50] [Stage 323:==============================> (28 + 1) / 50] [Stage 323:======================================> (35 + 1) / 50] [Stage 323:==========================================> (39 + 1) / 50] [Stage 323:=================================================> (45 + 1) / 50] 25/04/02 03:04:13 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:13 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:13 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:13 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:13 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:13 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 332:===========> (10 + 1) / 50] [Stage 332:================> (15 + 1) / 50] [Stage 332:====================> (19 + 1) / 50] [Stage 332:==========================> (24 + 1) / 50] [Stage 332:===============================> (29 + 1) / 50] [Stage 332:===================================> (32 + 1) / 50] [Stage 332:=========================================> (38 + 1) / 50] [Stage 332:================================================> (44 + 1) / 50] [Stage 332:=====================================================> (49 + 1) / 50] 25/04/02 03:04:17 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:17 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:17 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:17 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:17 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:17 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 347:===========> (10 + 1) / 50] [Stage 347:==============> (13 + 1) / 50] [Stage 347:===================> (18 + 1) / 50] [Stage 347:==========================> (24 + 1) / 50] [Stage 347:=================================> (30 + 1) / 50] [Stage 347:=====================================> (34 + 1) / 50] [Stage 347:==========================================> (39 + 1) / 50] [Stage 347:===============================================> (43 + 1) / 50] [Stage 347:===================================================> (47 + 1) / 50] 25/04/02 03:04:20 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:20 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:20 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:20 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:20 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:20 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 356:===========> (10 + 1) / 50] [Stage 356:=================> (16 + 1) / 50] [Stage 356:========================> (22 + 1) / 50] [Stage 356:==============================> (28 + 1) / 50] [Stage 356:=====================================> (34 + 1) / 50] [Stage 356:============================================> (40 + 1) / 50] [Stage 356:==================================================> (46 + 1) / 50] 25/04/02 03:04:23 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:23 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:23 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:23 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:23 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:23 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 365:==================> (17 + 1) / 50] [Stage 365:=========================> (23 + 1) / 50] [Stage 365:===============================> (29 + 1) / 50] [Stage 365:=====================================> (34 + 1) / 50] [Stage 365:============================================> (40 + 1) / 50] [Stage 365:==================================================> (46 + 1) / 50] 25/04/02 03:04:26 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:26 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:26 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:26 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:26 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:26 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 374:================> (15 + 1) / 50] [Stage 374:=======================> (21 + 1) / 50] [Stage 374:============================> (26 + 1) / 50] [Stage 374:==================================> (31 + 1) / 50] [Stage 374:========================================> (37 + 1) / 50] [Stage 374:=============================================> (41 + 1) / 50] [Stage 374:===================================================> (47 + 1) / 50] 25/04/02 03:04:29 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:29 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:29 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:29 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:29 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:29 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 383:=================> (16 + 1) / 50] [Stage 383:========================> (22 + 1) / 50] [Stage 383:==============================> (28 + 1) / 50] [Stage 383:=====================================> (34 + 1) / 50] [Stage 383:=============================================> (41 + 1) / 50] [Stage 383:===================================================> (47 + 1) / 50] 25/04/02 03:04:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:32 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 392:==================> (17 + 1) / 50] [Stage 392:=========================> (23 + 1) / 50] [Stage 392:===============================> (29 + 1) / 50] [Stage 392:=======================================> (36 + 1) / 50] [Stage 392:==============================================> (42 + 1) / 50] [Stage 392:====================================================> (48 + 1) / 50] 25/04/02 03:04:34 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:34 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:34 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:34 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:35 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:35 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 401:================> (15 + 1) / 50] [Stage 401:====================> (19 + 1) / 50] [Stage 401:=========================> (23 + 1) / 50] [Stage 401:===============================> (29 + 1) / 50] [Stage 401:=====================================> (34 + 1) / 50] [Stage 401:=========================================> (38 + 1) / 50] [Stage 401:=============================================> (41 + 1) / 50] [Stage 401:=================================================> (45 + 1) / 50] [Stage 401:=====================================================> (49 + 1) / 50] 25/04/02 03:04:38 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:38 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:38 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:38 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:38 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:38 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 410:=================> (16 + 1) / 50] [Stage 410:======================> (20 + 1) / 50] [Stage 410:============================> (26 + 1) / 50] [Stage 410:===================================> (32 + 1) / 50] [Stage 410:=========================================> (38 + 1) / 50] [Stage 410:================================================> (44 + 1) / 50] 25/04/02 03:04:41 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:41 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:41 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:41 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:41 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:41 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 419:=============> (12 + 1) / 50] [Stage 419:====================> (19 + 1) / 50] [Stage 419:===========================> (25 + 1) / 50] [Stage 419:==================================> (31 + 1) / 50] [Stage 419:========================================> (37 + 1) / 50] [Stage 419:===============================================> (43 + 1) / 50] [Stage 419:====================================================> (48 + 1) / 50] 25/04/02 03:04:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:44 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 428:================> (15 + 1) / 50] [Stage 428:======================> (20 + 1) / 50] [Stage 428:=============================> (27 + 1) / 50] [Stage 428:====================================> (33 + 1) / 50] [Stage 428:==========================================> (39 + 1) / 50] [Stage 428:=================================================> (45 + 1) / 50] 25/04/02 03:04:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:48 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 443:===============> (14 + 1) / 50] [Stage 443:======================> (20 + 1) / 50] [Stage 443:============================> (26 + 1) / 50] [Stage 443:===================================> (32 + 1) / 50] [Stage 443:==========================================> (39 + 1) / 50] [Stage 443:=================================================> (45 + 1) / 50] 25/04/02 03:04:50 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:50 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:50 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:50 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:51 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 452:==============> (13 + 1) / 50] [Stage 452:======================> (20 + 1) / 50] [Stage 452:============================> (26 + 1) / 50] [Stage 452:===================================> (32 + 1) / 50] [Stage 452:==========================================> (39 + 1) / 50] [Stage 452:=================================================> (45 + 1) / 50] 25/04/02 03:04:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:53 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 461:===============> (14 + 1) / 50] [Stage 461:======================> (20 + 1) / 50] [Stage 461:============================> (26 + 1) / 50] [Stage 461:====================================> (33 + 1) / 50] [Stage 461:==========================================> (39 + 1) / 50] [Stage 461:=================================================> (45 + 1) / 50] 25/04/02 03:04:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:04:56 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 470:=================> (16 + 1) / 50] [Stage 470:=======================> (21 + 1) / 50] [Stage 470:============================> (26 + 1) / 50] [Stage 470:=================================> (30 + 1) / 50] [Stage 470:=======================================> (36 + 1) / 50] [Stage 470:=============================================> (41 + 1) / 50] [Stage 470:=================================================> (45 + 1) / 50] {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None FAILED test_storage_delta/test.py::test_complex_types[0] FAILED test_storage_delta/test.py::test_complex_types[1] FAILED test_storage_delta/test.py::test_filesystem_cache[0-s3] [Stage 479:==================> (17 + 1) / 50] [Stage 479:=========================> (23 + 1) / 50] [Stage 479:==============================> (28 + 1) / 50] [Stage 479:===================================> (32 + 1) / 50] [Stage 479:=========================================> (38 + 1) / 50] [Stage 479:================================================> (44 + 1) / 50] {} {} Upload to bucket: None Upload to bucket: None FAILED test_storage_delta/test.py::test_filesystem_cache[1-s3] [Stage 488:==================> (17 + 1) / 50] [Stage 488:=========================> (23 + 1) / 50] [Stage 488:===============================> (29 + 1) / 50] [Stage 488:======================================> (35 + 1) / 50] [Stage 488:=============================================> (41 + 1) / 50] [Stage 488:===================================================> (47 + 1) / 50] {} {} Upload to bucket: None Upload to bucket: None FAILED test_storage_delta/test.py::test_metadata[0] [Stage 497:===================> (18 + 1) / 50] [Stage 497:==========================> (24 + 1) / 50] [Stage 497:===============================> (29 + 1) / 50] [Stage 497:======================================> (35 + 1) / 50] [Stage 497:============================================> (40 + 1) / 50] [Stage 497:==================================================> (46 + 1) / 50] {} {} Upload to bucket: None Upload to bucket: None FAILED test_storage_delta/test.py::test_metadata[1] [Stage 506:================> (15 + 1) / 50] [Stage 506:=======================> (21 + 1) / 50] [Stage 506:============================> (26 + 1) / 50] [Stage 506:===================================> (32 + 1) / 50] [Stage 506:=========================================> (38 + 1) / 50] [Stage 506:================================================> (44 + 1) / 50] {} Upload to bucket: None {} Upload to bucket: None FAILED test_storage_delta/test.py::test_multiple_log_files[0] 25/04/02 03:05:16 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:16 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:16 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:16 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:16 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:16 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 515:==============> (13 + 1) / 50] [Stage 515:====================> (19 + 1) / 50] [Stage 515:===========================> (25 + 1) / 50] [Stage 515:===================================> (32 + 1) / 50] [Stage 515:========================================> (37 + 1) / 50] [Stage 515:===============================================> (43 + 1) / 50] {} {} Upload to bucket: None Upload to bucket: None FAILED test_storage_delta/test.py::test_multiple_log_files[1] 25/04/02 03:05:19 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:19 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:19 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:19 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:19 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:19 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 524:================> (15 + 1) / 50] [Stage 524:========================> (22 + 1) / 50] [Stage 524:==============================> (28 + 1) / 50] [Stage 524:=====================================> (34 + 1) / 50] [Stage 524:=============================================> (41 + 1) / 50] [Stage 524:==================================================> (46 + 1) / 50] {} {} Upload to bucket: None Upload to bucket: None FAILED test_storage_delta/test.py::test_partition_by[0] 25/04/02 03:05:22 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:22 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:22 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:22 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:22 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:22 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 533:==================> (17 + 1) / 50] [Stage 533:========================> (22 + 2) / 50] [Stage 533:===============================> (29 + 1) / 50] [Stage 533:======================================> (35 + 1) / 50] [Stage 533:============================================> (40 + 1) / 50] [Stage 533:================================================> (44 + 1) / 50] {} {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None FAILED test_storage_delta/test.py::test_partition_by[1] 25/04/02 03:05:26 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:26 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:26 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:26 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:26 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. 25/04/02 03:05:26 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation. [Stage 542:===============> (14 + 1) / 50] [Stage 542:======================> (20 + 1) / 50] [Stage 542:=============================> (27 + 1) / 50] [Stage 542:====================================> (33 + 1) / 50] [Stage 542:==========================================> (39 + 1) / 50] [Stage 542:================================================> (44 + 1) / 50] [Stage 542:====================================================> (48 + 1) / 50] {} {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None {} Upload to bucket: None FAILED test_storage_delta/test.py::test_partition_columns[0] [Stage 549:=============> (12 + 1) / 50] [Stage 549:=================> (16 + 1) / 50] [Stage 549:======================> (20 + 1) / 50] [Stage 549:==========================> (24 + 1) / 50] [Stage 549:==============================> (28 + 1) / 50] [Stage 549:==================================> (31 + 1) / 50] [Stage 549:======================================> (35 + 1) / 50] [Stage 549:==========================================> (39 + 1) / 50] [Stage 549:=================================================> (45 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 553:> (0 + 1) / 1] [Stage 557:================> (15 + 1) / 50] [Stage 557:========================> (22 + 1) / 50] [Stage 557:==============================> (28 + 1) / 50] [Stage 557:=====================================> (34 + 1) / 50] [Stage 557:=============================================> (41 + 1) / 50] [Stage 557:===================================================> (47 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 565:===============> (14 + 1) / 50] [Stage 565:===================> (18 + 1) / 50] [Stage 565:========================> (22 + 1) / 50] [Stage 565:==============================> (28 + 1) / 50] [Stage 565:=====================================> (34 + 1) / 50] [Stage 565:============================================> (40 + 1) / 50] [Stage 565:================================================> (44 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 573:==================> (17 + 1) / 50] [Stage 573:==========================> (24 + 1) / 50] [Stage 573:=================================> (30 + 1) / 50] [Stage 573:========================================> (37 + 1) / 50] [Stage 573:==============================================> (42 + 1) / 50] [Stage 573:=================================================> (45 + 1) / 50] [Stage 573:====================================================> (48 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 581:===========> (10 + 1) / 50] [Stage 581:===============> (14 + 1) / 50] [Stage 581:======================> (20 + 1) / 50] [Stage 581:============================> (26 + 1) / 50] [Stage 581:====================================> (33 + 1) / 50] [Stage 581:==========================================> (39 + 1) / 50] [Stage 581:=================================================> (45 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 589:===============> (14 + 1) / 50] [Stage 589:======================> (20 + 1) / 50] [Stage 589:=============================> (27 + 1) / 50] [Stage 589:====================================> (33 + 1) / 50] [Stage 589:============================================> (40 + 1) / 50] [Stage 589:==================================================> (46 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 597:================> (15 + 1) / 50] [Stage 597:========================> (22 + 1) / 50] [Stage 597:==============================> (28 + 1) / 50] [Stage 597:==================================> (31 + 1) / 50] [Stage 597:======================================> (35 + 1) / 50] [Stage 597:=============================================> (41 + 1) / 50] [Stage 597:=================================================> (45 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 605:=================> (16 + 1) / 50] [Stage 605:======================> (20 + 1) / 50] [Stage 605:==========================> (24 + 1) / 50] [Stage 605:==============================> (28 + 1) / 50] [Stage 605:===================================> (32 + 1) / 50] [Stage 605:======================================> (35 + 1) / 50] [Stage 605:==========================================> (39 + 1) / 50] [Stage 605:===============================================> (43 + 1) / 50] [Stage 605:===================================================> (47 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 613:================> (15 + 1) / 50] [Stage 613:======================> (20 + 1) / 50] [Stage 613:==========================> (24 + 1) / 50] [Stage 613:===============================> (29 + 1) / 50] [Stage 613:=====================================> (34 + 1) / 50] [Stage 613:=========================================> (38 + 1) / 50] [Stage 613:===============================================> (43 + 1) / 50] [Stage 613:===================================================> (47 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 621:==================> (17 + 1) / 50] [Stage 621:=========================> (23 + 1) / 50] [Stage 621:===============================> (29 + 1) / 50] [Stage 621:======================================> (35 + 1) / 50] [Stage 621:=============================================> (41 + 1) / 50] [Stage 621:==================================================> (46 + 1) / 50] {} {} {} {} {} Upload to bucket: None {} {} {} {} Upload to bucket: None {} {} {} {} Upload to bucket: None {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None {} {} {} {} Upload to bucket: None {} {} {} {} Upload to bucket: None {} {} {} {} Upload to bucket: None {} {} {} {} Upload to bucket: None {} {} {} {} Upload to bucket: None {} {} {} {} Upload to bucket: None Uploaded files: ['/test_partition_columnsucoIbUwOdl/b=test8/c=2000-01-08/d=8/e=false/part-00000-02971798-01bb-4076-bcc8-6f9085a06224.c000.snappy.parquet', '/test_partition_columnsucoIbUwOdl/b=test7/c=2000-01-07/d=7/e=true/part-00000-1b95407a-0579-4a54-a7a5-2936871fe076.c000.snappy.parquet', '/test_partition_columnsucoIbUwOdl/b=test2/c=2000-01-02/d=2/e=false/part-00000-a392cf9e-34db-409a-a4b6-d029c89b61b3.c000.snappy.parquet', '/test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000007.json', '/test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000003.json', '/test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000008.json', '/test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000000.json', '/test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000001.json', '/test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000004.json', '/test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000002.json', '/test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000005.json', '/test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000006.json', '/test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000009.json', '/test_partition_columnsucoIbUwOdl/b=test1/c=2000-01-01/d=1/e=true/part-00000-3768c845-ed78-4a98-b109-52b15d0b8658.c000.snappy.parquet', '/test_partition_columnsucoIbUwOdl/b=test4/c=2000-01-04/d=4/e=false/part-00000-62546bf9-6f6c-4ea9-851a-61a4cff70bf6.c000.snappy.parquet', '/test_partition_columnsucoIbUwOdl/b=test6/c=2000-01-06/d=6/e=false/part-00000-fa180caa-e229-4ffe-9b9b-41b055c7c3ca.c000.snappy.parquet', '/test_partition_columnsucoIbUwOdl/b=test5/c=2000-01-05/d=5/e=true/part-00000-2b8b01c4-4f83-4909-bfd4-01de80a569cb.c000.snappy.parquet', '/test_partition_columnsucoIbUwOdl/b=test9/c=2000-01-09/d=9/e=true/part-00000-41cd9b47-2cf9-4251-b1f9-62cca33a8a11.c000.snappy.parquet', '/test_partition_columnsucoIbUwOdl/b=test3/c=2000-01-03/d=3/e=true/part-00000-0aea69d0-2f52-40a9-90a5-23a770c9a9a6.c000.snappy.parquet'] FAILED test_storage_delta/test.py::test_partition_columns[1] [Stage 628:================> (15 + 1) / 50] [Stage 628:=======================> (21 + 1) / 50] [Stage 628:=============================> (27 + 1) / 50] [Stage 628:====================================> (33 + 1) / 50] [Stage 628:=========================================> (38 + 1) / 50] [Stage 628:================================================> (44 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 636:==================> (17 + 1) / 50] [Stage 636:=========================> (23 + 1) / 50] [Stage 636:===============================> (29 + 1) / 50] [Stage 636:======================================> (35 + 1) / 50] [Stage 636:=============================================> (41 + 1) / 50] [Stage 636:====================================================> (48 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 644:=============> (12 + 1) / 50] [Stage 644:================> (15 + 1) / 50] [Stage 644:===================> (18 + 1) / 50] [Stage 644:========================> (22 + 1) / 50] [Stage 644:===========================> (25 + 1) / 50] [Stage 644:===============================> (29 + 1) / 50] [Stage 644:===================================> (32 + 1) / 50] [Stage 644:=======================================> (36 + 1) / 50] [Stage 644:==========================================> (39 + 1) / 50] [Stage 644:===============================================> (43 + 1) / 50] [Stage 644:==================================================> (46 + 1) / 50] [Stage 644:=====================================================> (49 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 652:==================> (17 + 1) / 50] [Stage 652:=========================> (23 + 1) / 50] [Stage 652:=================================> (30 + 1) / 50] [Stage 652:=======================================> (36 + 1) / 50] [Stage 652:==============================================> (42 + 1) / 50] [Stage 652:====================================================> (48 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 660:===========> (10 + 1) / 50] [Stage 660:=================> (16 + 1) / 50] [Stage 660:========================> (22 + 1) / 50] [Stage 660:=============================> (27 + 1) / 50] [Stage 660:====================================> (33 + 1) / 50] [Stage 660:==========================================> (39 + 1) / 50] [Stage 660:================================================> (44 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 668:===============> (14 + 1) / 50] [Stage 668:======================> (20 + 1) / 50] [Stage 668:=============================> (27 + 1) / 50] [Stage 668:====================================> (33 + 1) / 50] [Stage 668:==========================================> (39 + 1) / 50] [Stage 668:================================================> (44 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 676:===============> (14 + 1) / 50] [Stage 676:======================> (20 + 2) / 50] [Stage 676:============================> (26 + 1) / 50] [Stage 676:==================================> (31 + 1) / 50] [Stage 676:========================================> (37 + 1) / 50] [Stage 676:===============================================> (43 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 684:==================> (17 + 1) / 50] [Stage 684:==========================> (24 + 1) / 50] [Stage 684:=================================> (30 + 1) / 50] [Stage 684:=======================================> (36 + 1) / 50] [Stage 684:==============================================> (42 + 1) / 50] [Stage 684:===================================================> (47 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 692:=============> (12 + 1) / 50] [Stage 692:====================> (19 + 1) / 50] [Stage 692:===========================> (25 + 1) / 50] [Stage 692:===================================> (32 + 1) / 50] [Stage 692:=======================================> (36 + 1) / 50] [Stage 692:=============================================> (41 + 1) / 50] [Stage 692:=================================================> (45 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = true) |-- c: date (nullable = true) |-- d: integer (nullable = true) |-- e: boolean (nullable = true) [Stage 700:==============> (13 + 1) / 50] [Stage 700:====================> (19 + 1) / 50] [Stage 700:===========================> (25 + 1) / 50] [Stage 700:==================================> (31 + 1) / 50] [Stage 700:========================================> (37 + 1) / 50] [Stage 700:===============================================> (43 + 1) / 50] [Stage 700:=====================================================> (49 + 1) / 50] {} {} {} {} {} Upload to bucket: None {} {} {} {} Upload to bucket: None {} {} {} {} Upload to bucket: None {} Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None Upload to bucket: None {} {} {} {} Upload to bucket: None {} {} {} {} Upload to bucket: None {} {} {} {} Upload to bucket: None {} {} {} {} Upload to bucket: None {} {} {} {} Upload to bucket: None {} {} {} {} Upload to bucket: None Uploaded files: ['/test_partition_columnsstmhN6lkyb/b=test8/c=2000-01-08/d=8/e=false/part-00000-cc4c0b43-28c8-4a0c-a09d-c1828500c6e4.c000.snappy.parquet', '/test_partition_columnsstmhN6lkyb/b=test7/c=2000-01-07/d=7/e=true/part-00000-19cca5a5-28fb-4a4f-8523-b79f4df4b859.c000.snappy.parquet', '/test_partition_columnsstmhN6lkyb/b=test2/c=2000-01-02/d=2/e=false/part-00000-c8ef70c4-c34d-45ad-a9e4-ab25786165bc.c000.snappy.parquet', '/test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000007.json', '/test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000003.json', '/test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000008.json', '/test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000000.json', '/test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000001.json', '/test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000004.json', '/test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000002.json', '/test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000005.json', '/test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000006.json', '/test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000009.json', '/test_partition_columnsstmhN6lkyb/b=test1/c=2000-01-01/d=1/e=true/part-00000-d3b95943-0e27-4e1f-9cc0-4764bb5f3c08.c000.snappy.parquet', '/test_partition_columnsstmhN6lkyb/b=test4/c=2000-01-04/d=4/e=false/part-00000-3c6523b2-fef6-4e79-825e-c2f52fa26b2b.c000.snappy.parquet', '/test_partition_columnsstmhN6lkyb/b=test6/c=2000-01-06/d=6/e=false/part-00000-46acb1f7-7b4e-4f4c-af0b-f5f5b1cef829.c000.snappy.parquet', '/test_partition_columnsstmhN6lkyb/b=test5/c=2000-01-05/d=5/e=true/part-00000-814be19a-5881-4c33-970b-7c6b602473a3.c000.snappy.parquet', '/test_partition_columnsstmhN6lkyb/b=test9/c=2000-01-09/d=9/e=true/part-00000-8f5c3964-c70b-45ba-93ac-6dfb96a79b3a.c000.snappy.parquet', '/test_partition_columnsstmhN6lkyb/b=test3/c=2000-01-03/d=3/e=true/part-00000-6d443123-f3e2-4839-b068-dce75c639dbe.c000.snappy.parquet'] FAILED test_storage_delta/test.py::test_replicated_database_and_unavailable_s3[0] FAILED test_storage_delta/test.py::test_replicated_database_and_unavailable_s3[1] FAILED test_storage_delta/test.py::test_restart_broken[0] [Stage 709:================> (15 + 1) / 50] [Stage 709:========================> (22 + 1) / 50] [Stage 709:============================> (26 + 1) / 50] [Stage 709:===================================> (32 + 1) / 50] [Stage 709:=========================================> (38 + 1) / 50] [Stage 709:================================================> (44 + 1) / 50] {} Upload to bucket: None {} Upload to bucket: None FAILED test_storage_delta/test.py::test_restart_broken[1] [Stage 718:=============> (12 + 1) / 50] [Stage 718:=================> (16 + 1) / 50] [Stage 718:=======================> (21 + 1) / 50] [Stage 718:============================> (26 + 1) / 50] [Stage 718:==================================> (31 + 1) / 50] [Stage 718:======================================> (35 + 1) / 50] [Stage 718:=============================================> (41 + 1) / 50] [Stage 718:===================================================> (47 + 1) / 50] {} {} Upload to bucket: None Upload to bucket: None FAILED test_storage_delta/test.py::test_restart_broken_table_function[0] [Stage 727:==================> (17 + 1) / 50] [Stage 727:=========================> (23 + 1) / 50] [Stage 727:==============================> (28 + 1) / 50] [Stage 727:=====================================> (34 + 1) / 50] [Stage 727:============================================> (40 + 1) / 50] [Stage 727:================================================> (44 + 1) / 50] {} {} Upload to bucket: None Upload to bucket: None FAILED test_storage_delta/test.py::test_restart_broken_table_function[1] [Stage 736:===============> (14 + 1) / 50] [Stage 736:====================> (19 + 1) / 50] [Stage 736:==========================> (24 + 1) / 50] [Stage 736:=================================> (30 + 1) / 50] [Stage 736:=======================================> (36 + 1) / 50] [Stage 736:============================================> (40 + 1) / 50] [Stage 736:=================================================> (45 + 1) / 50] [Stage 736:=====================================================> (49 + 1) / 50] {} Upload to bucket: None {} Upload to bucket: None FAILED test_storage_delta/test.py::test_single_log_file[0] [Stage 745:================> (15 + 1) / 50] [Stage 745:========================> (22 + 1) / 50] [Stage 745:===============================> (29 + 1) / 50] [Stage 745:======================================> (35 + 1) / 50] [Stage 745:==============================================> (42 + 1) / 50] [Stage 745:====================================================> (48 + 1) / 50] {} {} Upload to bucket: None Upload to bucket: None FAILED test_storage_delta/test.py::test_single_log_file[1] [Stage 754:================> (15 + 1) / 50] [Stage 754:=======================> (21 + 1) / 50] [Stage 754:=============================> (27 + 1) / 50] [Stage 754:====================================> (33 + 1) / 50] [Stage 754:==========================================> (39 + 1) / 50] [Stage 754:==================================================> (46 + 1) / 50] {} Upload to bucket: None {} Upload to bucket: None FAILED test_storage_delta/test.py::test_types[0] [Stage 761:================> (15 + 1) / 50] [Stage 761:=======================> (21 + 1) / 50] [Stage 761:==============================> (28 + 1) / 50] [Stage 761:=====================================> (34 + 1) / 50] [Stage 761:=============================================> (41 + 1) / 50] [Stage 761:===================================================> (47 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = false) |-- c: date (nullable = false) |-- d: array (nullable = true) | |-- element: string (containsNull = true) |-- e: boolean (nullable = false) |-- f: array (nullable = true) | |-- element: string (containsNull = false) [Stage 769:=============> (12 + 1) / 50] [Stage 769:==================> (17 + 1) / 50] [Stage 769:==========================> (24 + 1) / 50] [Stage 769:=================================> (30 + 1) / 50] [Stage 769:=======================================> (36 + 1) / 50] [Stage 769:==============================================> (42 + 2) / 50] [Stage 769:====================================================> (48 + 1) / 50] {} Upload to bucket: None {} Upload to bucket: None Upload to bucket: None FAILED test_storage_delta/test.py::test_types[1] [Stage 776:================> (15 + 1) / 50] [Stage 776:=======================> (21 + 1) / 50] [Stage 776:=============================> (27 + 1) / 50] [Stage 776:==================================> (31 + 1) / 50] [Stage 776:=======================================> (36 + 1) / 50] [Stage 776:=============================================> (41 + 1) / 50] [Stage 776:====================================================> (48 + 1) / 50] root |-- a: integer (nullable = true) |-- b: string (nullable = false) |-- c: date (nullable = false) |-- d: array (nullable = true) | |-- element: string (containsNull = true) |-- e: boolean (nullable = false) |-- f: array (nullable = true) | |-- element: string (containsNull = false) [Stage 784:===================> (18 + 1) / 50] [Stage 784:=========================> (23 + 1) / 50] [Stage 784:===============================> (29 + 1) / 50] [Stage 784:======================================> (35 + 1) / 50] [Stage 784:=============================================> (41 + 1) / 50] [Stage 784:==================================================> (46 + 1) / 50] {} {} Upload to bucket: None Upload to bucket: None Upload to bucket: None FAILED test_storage_rabbitmq/test.py::test_rabbitmq_sharding_between_queues_publish Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml FAILED =================================== FAILURES =================================== ______________________________ test_checkpoint[0] ______________________________ started_cluster = use_delta_kernel = '0' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_checkpoint(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket TABLE_NAME = randomize_table_name("test_checkpoint") write_delta_from_df( spark, generate_data(spark, 0, 1), f"/{TABLE_NAME}", mode="overwrite", ) for i in range(1, 25): write_delta_from_df( spark, generate_data(spark, i, i + 1), f"/{TABLE_NAME}", mode="append", ) files = upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") # 25 data files # 25 metadata files # 1 last_metadata file # 2 checkpoints assert len(files) == 25 * 2 + 3 ok = False for file in files: if file.endswith("last_checkpoint"): ok = True assert ok > create_delta_table(instance, TABLE_NAME, use_delta_kernel=use_delta_kernel) test_storage_delta/test.py:262: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_delta/test.py:152: in create_delta_table node.query( helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 56, stderr: Received exception from server (version 25.2.2): E Code: 56. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table engine DeltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Storages/StorageFactory.cpp:276: DB::StorageFactory::getStorageFeatures(String const&) const @ 0x000000002d62e3cc E 5. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:105: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr const&, std::shared_ptr) @ 0x000000002995251c E 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1124: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a015adc E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 8. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 9. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 11. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 13. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 14. asan_thread_start(void*) @ 0x000000000b6a3e77 E 15. ? @ 0x00007fa1c9941ac3 E 16. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_STORAGE) E (query: CREATE TABLE test_checkpointyQ4gqOphBu E ENGINE=DeltaLake(s3, filename = 'test_checkpointyQ4gqOphBu/', url = 'http://minio1:9001/root/') E SETTINGS allow_experimental_delta_kernel_rs=0) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log setup ------------------------------ 2025-04-02 03:01:41 [ 600 ] DEBUG : Command:[docker ps | wc -l] (cluster.py:120, run_and_check) 2025-04-02 03:01:41 [ 600 ] DEBUG : Stdout:1 (cluster.py:144, run_and_check) 2025-04-02 03:01:41 [ 600 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2025-04-02 03:01:41 [ 600 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2025-04-02 03:01:41 [ 600 ] DEBUG : Command:[docker network prune --force] (cluster.py:120, run_and_check) 2025-04-02 03:01:41 [ 600 ] DEBUG : Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] (cluster.py:120, run_and_check) 2025-04-02 03:01:41 [ 600 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:144, run_and_check) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV HOSTNAME 7241bc02492c (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV SHLVL 0 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV HOME /root (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV OLDPWD / (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV DOCKER_HELPER_TAG 5dc43a6382f0 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV PYTEST_ADDOPTS -rfEps --run-id=1 --color=no --durations=0 'test_storage_delta/test.py::test_checkpoint[0]' 'test_storage_delta/test.py::test_checkpoint[1]' 'test_storage_delta/test.py::test_complex_types[0]' 'test_storage_delta/test.py::test_complex_types[1]' 'test_storage_delta/test.py::test_filesystem_cache[0-s3]' 'test_storage_delta/test.py::test_filesystem_cache[1-s3]' 'test_storage_delta/test.py::test_metadata[0]' 'test_storage_delta/test.py::test_metadata[1]' 'test_storage_delta/test.py::test_multiple_log_files[0]' 'test_storage_delta/test.py::test_multiple_log_files[1]' 'test_storage_delta/test.py::test_partition_by[0]' 'test_storage_delta/test.py::test_partition_by[1]' 'test_storage_delta/test.py::test_partition_columns[0]' 'test_storage_delta/test.py::test_partition_columns[1]' 'test_storage_delta/test.py::test_replicated_database_and_unavailable_s3[0]' 'test_storage_delta/test.py::test_replicated_database_and_unavailable_s3[1]' 'test_storage_delta/test.py::test_restart_broken[0]' 'test_storage_delta/test.py::test_restart_broken[1]' 'test_storage_delta/test.py::test_restart_broken_table_function[0]' 'test_storage_delta/test.py::test_restart_broken_table_function[1]' 'test_storage_delta/test.py::test_single_log_file[0]' 'test_storage_delta/test.py::test_single_log_file[1]' 'test_storage_delta/test.py::test_types[0]' 'test_storage_delta/test.py::test_types[1]' test_storage_rabbitmq/test.py::test_rabbitmq_sharding_between_queues_publish -vvv -ss (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV TZ Etc/UTC (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV DOCKER_BASE_TAG 8b2301119731 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 1 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV WORKER_FREE_PORTS 30000 30001 30002 30003 30004 30005 30006 30007 30008 30009 30010 30011 30012 30013 30014 30015 30016 30017 30018 30019 30020 30021 30022 30023 30024 30025 30026 30027 30028 30029 30030 30031 30032 30033 30034 30035 30036 30037 30038 30039 30040 30041 30042 30043 30044 30045 30046 30047 30048 30049 (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : ENV PYTEST_CURRENT_TEST test_storage_delta/test.py::test_checkpoint[0] (setup) (cluster.py:444, __init__) 2025-04-02 03:01:41 [ 600 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:749, __init__) 2025-04-02 03:01:44 [ 600 ] DEBUG : GatewayClient.address is deprecated and will be removed in version 1.0. Use GatewayParameters instead. (java_gateway.py:163, deprecated) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: A 4e31acc8b49aba886ff16fe5db0d85c5ba2dd8bb27afaa31f5712cdb6b61f9b1 (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: j i rj org.apache.spark.SparkConf e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: j i rj org.apache.spark.api.java.* e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: j i rj org.apache.spark.api.python.* e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: j i rj org.apache.spark.ml.python.* e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: j i rj org.apache.spark.mllib.api.python.* e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: j i rj org.apache.spark.resource.* e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: j i rj org.apache.spark.sql.* e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: j i rj org.apache.spark.sql.api.python.* e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: j i rj org.apache.spark.sql.hive.* e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: j i rj scala.Tuple2 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: r u SparkConf rj e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.SparkConf (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: i org.apache.spark.SparkConf bTrue e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yro0 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o0 set sspark.app.name sspark_test e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yro1 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o0 set sspark.master slocal e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yro2 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o0 contains sspark.serializer.objectStreamReset e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o0 set sspark.serializer.objectStreamReset s100 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yro3 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o0 contains sspark.rdd.compress e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o0 set sspark.rdd.compress sTrue e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yro4 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o0 contains sspark.master e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o0 contains sspark.app.name e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o0 contains sspark.master e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o0 get sspark.master e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yslocal (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o0 contains sspark.app.name e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o0 get sspark.app.name e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ysspark_test (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o0 contains sspark.home e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o0 getAll e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yto5 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a g o5 i0 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yro6 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o6 _1 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ysspark.master (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o6 _2 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yslocal (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a g o5 i1 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yro7 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o7 _1 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ysspark.app.name (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o7 _2 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ysspark_test (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a g o5 i2 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yro8 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o8 _1 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ysspark.app.submitTime (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o8 _2 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ys1743562903946 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a g o5 i3 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yro9 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o9 _1 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ysspark.rdd.compress (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o9 _2 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ysTrue (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a g o5 i4 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yro10 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o10 _1 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ysspark.serializer.objectStreamReset (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o10 _2 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ys100 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a g o5 i5 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yro11 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o11 _1 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ysspark.submit.pyFiles (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o11 _2 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ys (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a g o5 i6 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yro12 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o12 _1 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ysspark.submit.deployMode (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o12 _2 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ysclient (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a g o5 i7 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yro13 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o13 _1 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ysspark.ui.showConsoleProgress (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: c o13 _2 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ystrue (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: r u JavaSparkContext rj e (clientserver.py:501, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.java.JavaSparkContext (clientserver.py:512, send_command) 2025-04-02 03:01:44 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.java.JavaSparkContext ro0 e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: A 4e31acc8b49aba886ff16fe5db0d85c5ba2dd8bb27afaa31f5712cdb6b61f9b1 (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: m d o1 e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: m d o2 e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: m d o3 e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: m d o4 e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: m d o5 e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yro14 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c o14 sc e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yro15 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c o15 conf e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yro16 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u PythonAccumulatorV2 rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonAccumulatorV2 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonAccumulatorV2 s127.0.0.1 i64385 s4e31acc8b49aba886ff16fe5db0d85c5ba2dd8bb27afaa31f5712cdb6b61f9b1 e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yro17 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c o14 sc e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yro18 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c o18 register ro17 e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils isEncryptionEnabled e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils isEncryptionEnabled ro14 e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getPythonAuthSocketTimeout e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getPythonAuthSocketTimeout ro14 e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yL15 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getSparkBufferSize e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getSparkBufferSize ro14 e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yi65536 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.SparkFiles rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.SparkFiles (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.SparkFiles getRootDirectory e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.SparkFiles getRootDirectory e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ys/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/userFiles-ac61e0a8-2714-4f45-a789-1789bf4a4ea9 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c o16 get sspark.submit.pyFiles s e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ys (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.util rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.util.Utils rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.util.Utils (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.util.Utils getLocalDir e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c o14 sc e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yro19 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c o19 conf e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yro20 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.util.Utils getLocalDir ro20 e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ys/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.util rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.util.Utils rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.util.Utils (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.util.Utils createTempDir e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.util.Utils createTempDir s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84 spyspark e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yro21 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c o21 getAbsolutePath e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ys/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-b4a28ad6-e1d2-4bcb-8e50-3442333c0940 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c o16 get sspark.python.profile sfalse e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ysfalse (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getDefaultSession e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getDefaultSession e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yro22 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c o22 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c o14 sc e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yro23 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yao24 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c o24 put sspark.app.name sspark_test e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c o24 put sspark.master slocal e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: i org.apache.spark.sql.SparkSession ro23 ro24 e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yro25 (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setDefaultSession e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setDefaultSession ro25 e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro25 e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Command to send: c o14 stop e (clientserver.py:501, send_command) 2025-04-02 03:01:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: m d o0 e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: m d o6 e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: m d o7 e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: m d o8 e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: m d o9 e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: m d o10 e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: m d o11 e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: m d o12 e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: m d o13 e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: m d o15 e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: m d o24 e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession clearDefaultSession e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession clearDefaultSession e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession clearActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession clearActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:46 [ 600 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1667, add_instance) 2025-04-02 03:01:46 [ 600 ] DEBUG : Setup Keeper (cluster.py:1051, setup_keeper_cmd) 2025-04-02 03:01:46 [ 600 ] DEBUG : Cluster name: project_name:rootteststoragedelta. Added instance name:node1 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_storage_delta/_instances-1/.env', '--project-name', 'rootteststoragedelta', '--file', '/ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1947, add_instance) 2025-04-02 03:01:46 [ 600 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1667, add_instance) 2025-04-02 03:01:46 [ 600 ] DEBUG : Cluster name: project_name:rootteststoragedelta. Added instance name:node2 tag:8b2301119731 base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_storage_delta/_instances-1/.env', '--project-name', 'rootteststoragedelta', '--file', '/ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_delta/_instances-1/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1947, add_instance) 2025-04-02 03:01:46 [ 600 ] INFO : Starting cluster... (test.py:97, started_cluster) 2025-04-02 03:01:46 [ 600 ] INFO : Running tests in /ClickHouse/tests/integration/test_storage_delta/test.py (cluster.py:2677, start) 2025-04-02 03:01:46 [ 600 ] DEBUG : Cluster start called. is_up=False (cluster.py:2684, start) 2025-04-02 03:01:46 [ 600 ] DEBUG : Docker networks for project rootteststoragedelta are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2025-04-02 03:01:46 [ 600 ] DEBUG : Docker containers for project rootteststoragedelta are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2025-04-02 03:01:46 [ 600 ] DEBUG : Docker volumes for project rootteststoragedelta are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2025-04-02 03:01:46 [ 600 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2025-04-02 03:01:46 [ 600 ] DEBUG : Docker networks for project rootteststoragedelta are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2025-04-02 03:01:46 [ 600 ] DEBUG : Docker containers for project rootteststoragedelta are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2025-04-02 03:01:46 [ 600 ] DEBUG : Docker volumes for project rootteststoragedelta are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command:[docker container list --all --filter name='^/rootteststoragedelta-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:120, run_and_check) 2025-04-02 03:01:46 [ 600 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2025-04-02 03:01:46 [ 600 ] DEBUG : No running containers for project: rootteststoragedelta (cluster.py:904, cleanup) 2025-04-02 03:01:46 [ 600 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2025-04-02 03:01:46 [ 600 ] DEBUG : Trying to prune unused images... (cluster.py:926, cleanup) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command:[docker image prune -f] (cluster.py:120, run_and_check) 2025-04-02 03:01:46 [ 600 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:144, run_and_check) 2025-04-02 03:01:46 [ 600 ] DEBUG : Images pruned (cluster.py:929, cleanup) 2025-04-02 03:01:46 [ 600 ] DEBUG : Trying to prune unused volumes... (cluster.py:935, cleanup) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:120, run_and_check) 2025-04-02 03:01:46 [ 600 ] DEBUG : Stdout:1 (cluster.py:144, run_and_check) 2025-04-02 03:01:46 [ 600 ] DEBUG : Volumes pruned: 1 (cluster.py:940, cleanup) 2025-04-02 03:01:46 [ 600 ] DEBUG : Setup directory for instance: node1 (cluster.py:2697, start) 2025-04-02 03:01:46 [ 600 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4530, create_dir) 2025-04-02 03:01:46 [ 600 ] DEBUG : Create directory for common tests configuration (cluster.py:4535, create_dir) 2025-04-02 03:01:46 [ 600 ] DEBUG : Copy common configuration from helpers (cluster.py:4555, create_dir) 2025-04-02 03:01:46 [ 600 ] DEBUG : Generate and write macros file (cluster.py:4607, create_dir) 2025-04-02 03:01:46 [ 600 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_storage_delta/configs/config.d/named_collections.xml', '/ClickHouse/tests/integration/test_storage_delta/configs/config.d/filesystem_caches.xml', '/ClickHouse/tests/integration/test_storage_delta/configs/config.d/remote_servers.xml'] to /ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/configs/config.d (cluster.py:4643, create_dir) 2025-04-02 03:01:46 [ 600 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/database (cluster.py:4660, create_dir) 2025-04-02 03:01:46 [ 600 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/logs (cluster.py:4671, create_dir) 2025-04-02 03:01:46 [ 600 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" (cluster.py:4752, create_dir) 2025-04-02 03:01:46 [ 600 ] DEBUG : Setup directory for instance: node2 (cluster.py:2697, start) 2025-04-02 03:01:46 [ 600 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4530, create_dir) 2025-04-02 03:01:46 [ 600 ] DEBUG : Create directory for common tests configuration (cluster.py:4535, create_dir) 2025-04-02 03:01:46 [ 600 ] DEBUG : Copy common configuration from helpers (cluster.py:4555, create_dir) 2025-04-02 03:01:46 [ 600 ] DEBUG : Generate and write macros file (cluster.py:4607, create_dir) 2025-04-02 03:01:46 [ 600 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_storage_delta/configs/config.d/named_collections.xml', '/ClickHouse/tests/integration/test_storage_delta/configs/config.d/remote_servers.xml'] to /ClickHouse/tests/integration/test_storage_delta/_instances-1/node2/configs/config.d (cluster.py:4643, create_dir) 2025-04-02 03:01:46 [ 600 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_delta/_instances-1/node2/database (cluster.py:4660, create_dir) 2025-04-02 03:01:46 [ 600 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_delta/_instances-1/node2/logs (cluster.py:4671, create_dir) 2025-04-02 03:01:46 [ 600 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" (cluster.py:4752, create_dir) 2025-04-02 03:01:46 [ 600 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:8b2301119731', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_storage_delta/_instances-1/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_storage_delta/_instances-1/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_storage_delta/_instances-1/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_storage_delta/_instances-1/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_storage_delta/_instances-1/.env (cluster.py:95, _create_env_file) 2025-04-02 03:01:46 [ 600 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-04-02 03:01:46 [ 600 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-04-02 03:01:46 [ 600 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-04-02 03:01:46 [ 600 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-04-02 03:01:46 [ 600 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:547, _make_request) 2025-04-02 03:01:46 [ 600 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_storage_delta/_instances-1/.env --project-name rootteststoragedelta --file /ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_storage_delta/_instances-1/node2/docker-compose.yml pull] (cluster.py:120, run_and_check) 2025-04-02 03:01:47 [ 600 ] DEBUG : Command to send: m d o19 e (clientserver.py:501, send_command) 2025-04-02 03:01:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:47 [ 600 ] DEBUG : Command to send: m d o20 e (clientserver.py:501, send_command) 2025-04-02 03:01:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:47 [ 600 ] DEBUG : Command to send: m d o21 e (clientserver.py:501, send_command) 2025-04-02 03:01:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:47 [ 600 ] DEBUG : Command to send: m d o22 e (clientserver.py:501, send_command) 2025-04-02 03:01:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:47 [ 600 ] DEBUG : Command to send: m d o23 e (clientserver.py:501, send_command) 2025-04-02 03:01:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:01:57 [ 600 ] DEBUG : Stderr: zoo3 Skipped - Image is already being pulled by node1 (cluster.py:146, run_and_check) 2025-04-02 03:01:57 [ 600 ] DEBUG : Stderr: zoo1 Skipped - Image is already being pulled by node1 (cluster.py:146, run_and_check) 2025-04-02 03:01:57 [ 600 ] DEBUG : Stderr: node2 Skipped - Image is already being pulled by node1 (cluster.py:146, run_and_check) 2025-04-02 03:01:57 [ 600 ] DEBUG : Stderr: zoo2 Skipped - Image is already being pulled by node1 (cluster.py:146, run_and_check) 2025-04-02 03:01:57 [ 600 ] DEBUG : Stderr: proxy1 Skipped - Image is already being pulled by proxy2 (cluster.py:146, run_and_check) 2025-04-02 03:01:57 [ 600 ] DEBUG : Stderr: minio1 Pulling (cluster.py:146, run_and_check) 2025-04-02 03:01:57 [ 600 ] DEBUG : Stderr: node1 Pulling (cluster.py:146, run_and_check) 2025-04-02 03:01:57 [ 600 ] DEBUG : Stderr: resolver Pulling (cluster.py:146, run_and_check) 2025-04-02 03:01:57 [ 600 ] DEBUG : Stderr: proxy2 Pulling (cluster.py:146, run_and_check) 2025-04-02 03:01:57 [ 600 ] DEBUG : Stderr: proxy2 Pulled (cluster.py:146, run_and_check) 2025-04-02 03:01:57 [ 600 ] DEBUG : Stderr: resolver Pulled (cluster.py:146, run_and_check) 2025-04-02 03:01:57 [ 600 ] DEBUG : Stderr: node1 Pulled (cluster.py:146, run_and_check) 2025-04-02 03:01:57 [ 600 ] DEBUG : Stderr: minio1 Pulled (cluster.py:146, run_and_check) 2025-04-02 03:01:57 [ 600 ] DEBUG : Setup ZooKeeper (cluster.py:2738, start) 2025-04-02 03:01:57 [ 600 ] DEBUG : Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper1/log', '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper1/config', '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper1/coordination', '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper2/log', '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper2/config', '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper2/coordination', '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper3/log', '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper3/config', '/ClickHouse/tests/integration/test_storage_delta/_instances-1/keeper3/coordination'] (cluster.py:2739, start) 2025-04-02 03:01:57 [ 600 ] DEBUG : Command:[docker compose --project-name rootteststoragedelta --env-file /ClickHouse/tests/integration/test_storage_delta/_instances-1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] (cluster.py:120, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr:time="2025-04-02T03:01:57Z" level=trace msg="Docker Desktop integration not enabled" (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr: Network rootteststoragedelta_default Creating (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr: Network rootteststoragedelta_default Created (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo2-1 Creating (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo1-1 Creating (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo3-1 Creating (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo2-1 Created (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo1-1 Created (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo3-1 Created (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo2-1 Starting (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo1-1 Starting (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo3-1 Starting (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo3-1 Started (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo2-1 Started (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo1-1 Started (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr:time="2025-04-02T03:01:58Z" level=debug msg="otel error" error="" (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Stderr:time="2025-04-02T03:01:58Z" level=debug msg="otel error" error="" (cluster.py:146, run_and_check) 2025-04-02 03:01:58 [ 600 ] DEBUG : Wait ZooKeeper to start (cluster.py:2403, wait_zookeeper_to_start) 2025-04-02 03:01:58 [ 600 ] DEBUG : get_instance_ip instance_name=zoo1 (cluster.py:2004, get_instance_ip) 2025-04-02 03:01:58 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragedelta-zoo1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:01:58 [ 600 ] DEBUG : get_kazoo_client: zoo1, ip:172.16.1.2, port:2181, use_ssl:False (cluster.py:3223, get_kazoo_client) 2025-04-02 03:01:58 [ 600 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2025-04-02 03:01:58 [ 600 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-04-02 03:01:58 [ 600 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2025-04-02 03:01:58 [ 600 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-04-02 03:01:58 [ 600 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2025-04-02 03:01:58 [ 600 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-04-02 03:01:59 [ 600 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2025-04-02 03:01:59 [ 600 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-04-02 03:01:59 [ 600 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2025-04-02 03:01:59 [ 600 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-04-02 03:02:00 [ 600 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2025-04-02 03:02:00 [ 600 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-04-02 03:02:01 [ 600 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2025-04-02 03:02:01 [ 600 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-04-02 03:02:03 [ 600 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2025-04-02 03:02:03 [ 600 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2025-04-02 03:02:03 [ 600 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2025-04-02 03:02:03 [ 600 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2025-04-02 03:02:03 [ 600 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2025-04-02 03:02:03 [ 600 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2025-04-02 03:02:03 [ 600 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2025-04-02 03:02:03 [ 600 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2025-04-02 03:02:03 [ 600 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2025-04-02 03:02:04 [ 600 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2025-04-02 03:02:04 [ 600 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2025-04-02 03:02:04 [ 600 ] DEBUG : get_instance_ip instance_name=zoo2 (cluster.py:2004, get_instance_ip) 2025-04-02 03:02:04 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragedelta-zoo2-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:04 [ 600 ] DEBUG : get_kazoo_client: zoo2, ip:172.16.1.4, port:2181, use_ssl:False (cluster.py:3223, get_kazoo_client) 2025-04-02 03:02:04 [ 600 ] INFO : Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False (connection.py:650, _connect) 2025-04-02 03:02:04 [ 600 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2025-04-02 03:02:04 [ 600 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2025-04-02 03:02:04 [ 600 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2025-04-02 03:02:04 [ 600 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2025-04-02 03:02:04 [ 600 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2025-04-02 03:02:04 [ 600 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2025-04-02 03:02:04 [ 600 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2025-04-02 03:02:04 [ 600 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2025-04-02 03:02:04 [ 600 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2025-04-02 03:02:04 [ 600 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2025-04-02 03:02:04 [ 600 ] DEBUG : get_instance_ip instance_name=zoo3 (cluster.py:2004, get_instance_ip) 2025-04-02 03:02:04 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragedelta-zoo3-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:04 [ 600 ] DEBUG : get_kazoo_client: zoo3, ip:172.16.1.3, port:2181, use_ssl:False (cluster.py:3223, get_kazoo_client) 2025-04-02 03:02:04 [ 600 ] INFO : Connecting to 172.16.1.3(172.16.1.3):2181, use_ssl: False (connection.py:650, _connect) 2025-04-02 03:02:04 [ 600 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2025-04-02 03:02:04 [ 600 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2025-04-02 03:02:04 [ 600 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2025-04-02 03:02:04 [ 600 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2025-04-02 03:02:04 [ 600 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2025-04-02 03:02:04 [ 600 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2025-04-02 03:02:04 [ 600 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2025-04-02 03:02:04 [ 600 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2025-04-02 03:02:04 [ 600 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2025-04-02 03:02:04 [ 600 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2025-04-02 03:02:04 [ 600 ] DEBUG : All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') (cluster.py:2419, wait_zookeeper_nodes_to_start) 2025-04-02 03:02:04 [ 600 ] INFO : Trying to create Minio instance by command docker compose --project-name rootteststoragedelta --env-file /ClickHouse/tests/integration/test_storage_delta/_instances-1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d (cluster.py:2998, start) 2025-04-02 03:02:04 [ 600 ] DEBUG : Command:[docker compose --project-name rootteststoragedelta --env-file /ClickHouse/tests/integration/test_storage_delta/_instances-1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] (cluster.py:120, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr:time="2025-04-02T03:02:04Z" level=trace msg="Docker Desktop integration not enabled" (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Volume "rootteststoragedelta_data1-1" Creating (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Volume "rootteststoragedelta_data1-1" Created (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr:time="2025-04-02T03:02:04Z" level=warning msg="Found orphan containers ([rootteststoragedelta-zoo3-1 rootteststoragedelta-zoo2-1 rootteststoragedelta-zoo1-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up." (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy2-1 Creating (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy1-1 Creating (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy1-1 Created (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy2-1 Created (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-resolver-1 Creating (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-minio1-1 Creating (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-resolver-1 Created (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-minio1-1 Created (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy2-1 Starting (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy1-1 Starting (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy1-1 Started (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy2-1 Started (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-resolver-1 Starting (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-minio1-1 Starting (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-resolver-1 Started (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-minio1-1 Started (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr:time="2025-04-02T03:02:05Z" level=debug msg="otel error" error="" (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] DEBUG : Stderr:time="2025-04-02T03:02:05Z" level=debug msg="otel error" error="" (cluster.py:146, run_and_check) 2025-04-02 03:02:05 [ 600 ] INFO : Trying to connect to Minio... (cluster.py:3004, start) 2025-04-02 03:02:05 [ 600 ] DEBUG : get_instance_ip instance_name=minio1 (cluster.py:2004, get_instance_ip) 2025-04-02 03:02:05 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragedelta-minio1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:05 [ 600 ] DEBUG : get_instance_ip instance_name=proxy1 (cluster.py:2004, get_instance_ip) 2025-04-02 03:02:05 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragedelta-proxy1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:05 [ 600 ] DEBUG : Starting new HTTP connection (1): 172.16.1.8:9001 (connectionpool.py:245, _new_conn) 2025-04-02 03:02:05 [ 600 ] DEBUG : Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) (retry.py:517, increment) 2025-04-02 03:02:05 [ 600 ] WARNING : Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / (connectionpool.py:872, urlopen) 2025-04-02 03:02:05 [ 600 ] DEBUG : Starting new HTTP connection (2): 172.16.1.8:9001 (connectionpool.py:245, _new_conn) 2025-04-02 03:02:05 [ 600 ] DEBUG : Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) (retry.py:517, increment) 2025-04-02 03:02:05 [ 600 ] WARNING : Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / (connectionpool.py:872, urlopen) 2025-04-02 03:02:05 [ 600 ] DEBUG : Starting new HTTP connection (3): 172.16.1.8:9001 (connectionpool.py:245, _new_conn) 2025-04-02 03:02:05 [ 600 ] DEBUG : Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) (retry.py:517, increment) 2025-04-02 03:02:05 [ 600 ] WARNING : Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / (connectionpool.py:872, urlopen) 2025-04-02 03:02:05 [ 600 ] DEBUG : Starting new HTTP connection (4): 172.16.1.8:9001 (connectionpool.py:245, _new_conn) 2025-04-02 03:02:05 [ 600 ] DEBUG : Can't connect to Minio: HTTPConnectionPool(host='172.16.1.8', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) (cluster.py:2521, wait_minio_to_start) 2025-04-02 03:02:06 [ 600 ] DEBUG : Starting new HTTP connection (5): 172.16.1.8:9001 (connectionpool.py:245, _new_conn) 2025-04-02 03:02:06 [ 600 ] DEBUG : http://172.16.1.8:9001 "GET / HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:02:06 [ 600 ] DEBUG : Connected to Minio. (cluster.py:2501, wait_minio_to_start) 2025-04-02 03:02:06 [ 600 ] DEBUG : http://172.16.1.8:9001 "GET /root?location= HTTP/1.1" 404 0 (connectionpool.py:547, _make_request) 2025-04-02 03:02:06 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:02:06 [ 600 ] DEBUG : S3 bucket 'root' created (cluster.py:2516, wait_minio_to_start) 2025-04-02 03:02:06 [ 600 ] DEBUG : http://172.16.1.8:9001 "GET /root2?location= HTTP/1.1" 404 0 (connectionpool.py:547, _make_request) 2025-04-02 03:02:06 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root2 HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:02:06 [ 600 ] DEBUG : S3 bucket 'root2' created (cluster.py:2516, wait_minio_to_start) 2025-04-02 03:02:06 [ 600 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_storage_delta/_instances-1/.env --project-name rootteststoragedelta --file /ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_storage_delta/_instances-1/node2/docker-compose.yml up -d --no-recreate') (cluster.py:3066, start) 2025-04-02 03:02:06 [ 600 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_storage_delta/_instances-1/.env --project-name rootteststoragedelta --file /ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_storage_delta/_instances-1/node2/docker-compose.yml up -d --no-recreate] (cluster.py:120, run_and_check) 2025-04-02 03:02:07 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy1-1 Running (cluster.py:146, run_and_check) 2025-04-02 03:02:07 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy2-1 Running (cluster.py:146, run_and_check) 2025-04-02 03:02:07 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo3-1 Running (cluster.py:146, run_and_check) 2025-04-02 03:02:07 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo2-1 Running (cluster.py:146, run_and_check) 2025-04-02 03:02:07 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-resolver-1 Running (cluster.py:146, run_and_check) 2025-04-02 03:02:07 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo1-1 Running (cluster.py:146, run_and_check) 2025-04-02 03:02:07 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-minio1-1 Running (cluster.py:146, run_and_check) 2025-04-02 03:02:07 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node1-1 Creating (cluster.py:146, run_and_check) 2025-04-02 03:02:07 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node2-1 Creating (cluster.py:146, run_and_check) 2025-04-02 03:02:07 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node1-1 Created (cluster.py:146, run_and_check) 2025-04-02 03:02:07 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node2-1 Created (cluster.py:146, run_and_check) 2025-04-02 03:02:07 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node1-1 Starting (cluster.py:146, run_and_check) 2025-04-02 03:02:07 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node2-1 Starting (cluster.py:146, run_and_check) 2025-04-02 03:02:07 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node2-1 Started (cluster.py:146, run_and_check) 2025-04-02 03:02:07 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node1-1 Started (cluster.py:146, run_and_check) 2025-04-02 03:02:07 [ 600 ] DEBUG : ClickHouse instance created (cluster.py:3074, start) 2025-04-02 03:02:07 [ 600 ] DEBUG : get_instance_ip instance_name=node1 (cluster.py:2004, get_instance_ip) 2025-04-02 03:02:07 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragedelta-node1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:07 [ 600 ] DEBUG : get_instance_ip instance_name=node1 (cluster.py:2014, get_instance_global_ipv6) 2025-04-02 03:02:07 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragedelta-node1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:07 [ 600 ] DEBUG : Waiting for ClickHouse start in node1, ip: 172.16.1.9... (cluster.py:3082, start) 2025-04-02 03:02:07 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragedelta-node1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:07 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:07 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:07 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:07 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:07 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:07 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:07 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:07 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:07 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:07 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/44542b1062575988e1ec02392d2ce83ca52c57c80b2acf6068cc9020ab8537a6/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : ClickHouse node1 started (cluster.py:3086, start) 2025-04-02 03:02:08 [ 600 ] DEBUG : get_instance_ip instance_name=node2 (cluster.py:2004, get_instance_ip) 2025-04-02 03:02:08 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragedelta-node2-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : get_instance_ip instance_name=node2 (cluster.py:2014, get_instance_global_ipv6) 2025-04-02 03:02:08 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragedelta-node2-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : Waiting for ClickHouse start in node2, ip: 172.16.1.10... (cluster.py:3082, start) 2025-04-02 03:02:08 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragedelta-node2-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/27b06fd5d05f329f3207722c343045f031908b1b7197012834244972db1f0f85/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/27b06fd5d05f329f3207722c343045f031908b1b7197012834244972db1f0f85/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : ClickHouse node2 started (cluster.py:3086, start) 2025-04-02 03:02:08 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root?policy= HTTP/1.1" 204 0 (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : http://172.16.1.8:9001 "GET /root-with-auth?location= HTTP/1.1" 404 0 (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root-with-auth HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: r u SparkConf rj e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.SparkConf (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: i org.apache.spark.SparkConf bTrue e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro26 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 set sspark.app.name sspark_test e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro27 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 set sspark.master slocal e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro28 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 set sspark.sql.extensions sio.delta.sql.DeltaSparkSessionExtension e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro29 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 set sspark.sql.catalog.spark_catalog sorg.apache.spark.sql.delta.catalog.DeltaCatalog e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro30 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 get sspark.executor.allowSparkContext sfalse e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysfalse (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 contains sspark.serializer.objectStreamReset e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 set sspark.serializer.objectStreamReset s100 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro31 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 contains sspark.rdd.compress e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 set sspark.rdd.compress sTrue e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro32 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 contains sspark.master e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 contains sspark.app.name e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 contains sspark.master e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 get sspark.master e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yslocal (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 contains sspark.app.name e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 get sspark.app.name e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysspark_test (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 contains sspark.home e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o26 getAll e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yto33 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a e o33 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yi10 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a g o33 i0 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro34 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o34 _1 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysspark.master (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o34 _2 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yslocal (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a e o33 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yi10 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a g o33 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro35 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o35 _1 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysspark.sql.extensions (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o35 _2 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysio.delta.sql.DeltaSparkSessionExtension (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a e o33 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yi10 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a g o33 i2 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro36 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o36 _1 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysspark.app.name (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o36 _2 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysspark_test (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a e o33 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yi10 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a g o33 i3 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro37 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o37 _1 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysspark.app.submitTime (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o37 _2 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ys1743562903946 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a e o33 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yi10 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a g o33 i4 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro38 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o38 _1 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysspark.rdd.compress (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o38 _2 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysTrue (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a e o33 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yi10 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a g o33 i5 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro39 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o39 _1 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysspark.serializer.objectStreamReset (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o39 _2 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ys100 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a e o33 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yi10 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a g o33 i6 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro40 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o40 _1 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysspark.submit.pyFiles (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o40 _2 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ys (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a e o33 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yi10 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a g o33 i7 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro41 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o41 _1 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysspark.submit.deployMode (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o41 _2 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysclient (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a e o33 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yi10 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a g o33 i8 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro42 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o42 _1 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysspark.ui.showConsoleProgress (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o42 _2 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ystrue (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a e o33 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yi10 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a g o33 i9 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yro43 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o43 _1 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysspark.sql.catalog.spark_catalog (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: c o43 _2 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ysorg.apache.spark.sql.delta.catalog.DeltaCatalog (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: a e o33 e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !yi10 (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: r u JavaSparkContext rj e (clientserver.py:501, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.java.JavaSparkContext (clientserver.py:512, send_command) 2025-04-02 03:02:08 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.java.JavaSparkContext ro26 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: m d o27 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: m d o28 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: m d o29 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: m d o30 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: m d o31 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: m d o32 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: m d o18 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: m d o34 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: m d o35 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: m d o36 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: m d o37 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: m d o38 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: m d o39 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: m d o40 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: m d o41 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: m d o33 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yro44 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yro45 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o45 conf e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yro46 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u PythonAccumulatorV2 rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonAccumulatorV2 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonAccumulatorV2 s127.0.0.1 i58219 s4e31acc8b49aba886ff16fe5db0d85c5ba2dd8bb27afaa31f5712cdb6b61f9b1 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yro47 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yro48 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o48 register ro47 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils isEncryptionEnabled e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils isEncryptionEnabled ro44 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getPythonAuthSocketTimeout e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getPythonAuthSocketTimeout ro44 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yL15 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getSparkBufferSize e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getSparkBufferSize ro44 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yi65536 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u org.apache.spark.SparkFiles rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.SparkFiles (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.SparkFiles getRootDirectory e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.SparkFiles getRootDirectory e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ys/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/userFiles-10f5cc14-ac57-4c3d-b86b-857d27f33ae5 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o46 get sspark.submit.pyFiles s e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ys (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u org.apache.spark.util rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u org.apache.spark.util.Utils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.util.Utils (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.util.Utils getLocalDir e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yro49 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o49 conf e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yro50 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.util.Utils getLocalDir ro50 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ys/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u org.apache.spark.util rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u org.apache.spark.util.Utils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.util.Utils (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.util.Utils createTempDir e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.util.Utils createTempDir s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84 spyspark e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yro51 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o51 getAbsolutePath e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ys/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o46 get sspark.python.profile sfalse e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ysfalse (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getDefaultSession e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getDefaultSession e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yro52 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o52 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yro53 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yao54 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o54 put sspark.app.name sspark_test e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o54 put sspark.master slocal e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o54 put sspark.sql.extensions sio.delta.sql.DeltaSparkSessionExtension e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o54 put sspark.sql.catalog.spark_catalog sorg.apache.spark.sql.delta.catalog.DeltaCatalog e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: i org.apache.spark.sql.SparkSession ro53 ro54 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yro55 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setDefaultSession e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setDefaultSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) ------------------------------ Captured log call ------------------------------- 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yro56 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o56 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:09 [ 600 ] DEBUG : Command to send: c o55 range i0 i1 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:10 [ 600 ] DEBUG : Command to send: m d o54 e (clientserver.py:501, send_command) 2025-04-02 03:02:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yro57 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !ylo58 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c o58 add sa e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro58 e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yro59 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c o57 toDF ro59 e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yro60 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yro61 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c o61 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c o55 range i1 i2 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yro62 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !ylo63 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c o63 add sb e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro63 e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yro64 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c o62 toDF ro64 e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yro65 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c o65 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yro66 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yro67 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c o67 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yro68 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c o68 get e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yro69 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yro70 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yao71 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c o70 applyModifiableSettings ro69 ro71 e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yro72 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c o66 cast ro72 e (clientserver.py:501, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Answer received: !yro73 (clientserver.py:512, send_command) 2025-04-02 03:02:11 [ 600 ] DEBUG : Command to send: c o65 withColumn sb ro73 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro74 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro75 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro76 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ylo77 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c o77 add ro76 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro77 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro78 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro78 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro79 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c o75 over ro79 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro80 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c o60 withColumn srow_index ro80 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro81 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro82 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro83 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ylo84 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c o84 add ro83 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro84 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro85 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro85 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro86 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c o82 over ro86 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro87 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c o74 withColumn srow_index ro87 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro88 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o58 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o63 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o45 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ylo89 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c o89 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o48 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro89 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro90 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o49 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c o81 join ro88 ro90 sinner e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o50 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o51 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o52 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o53 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o56 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o57 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o59 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o61 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o62 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o64 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o67 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o68 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o71 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o77 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o84 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: m d o89 e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro91 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c o91 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro92 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c o92 write e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro93 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c o93 mode soverwrite e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro94 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c o94 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro95 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c o95 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro96 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c o96 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Answer received: !yro97 (clientserver.py:512, send_command) 2025-04-02 03:02:12 [ 600 ] DEBUG : Command to send: c o97 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro98 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o98 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o55 range i1 i2 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro99 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ylo100 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o100 add sa e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro100 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro101 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o99 toDF ro101 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro102 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro103 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o103 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o55 range i2 i3 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro104 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ylo105 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o105 add sb e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro105 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro106 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o104 toDF ro106 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro107 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o107 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro108 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro109 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o109 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro110 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o110 get e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro111 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro112 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yao113 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o112 applyModifiableSettings ro111 ro113 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro114 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o108 cast ro114 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro115 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o107 withColumn sb ro115 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro116 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro117 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro118 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ylo119 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o119 add ro118 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro119 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro120 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro120 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro121 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o117 over ro121 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro122 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o102 withColumn srow_index ro122 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro123 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro124 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro125 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ylo126 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o126 add ro125 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro126 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro127 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro127 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro128 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o124 over ro128 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro129 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o116 withColumn srow_index ro129 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro130 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ylo131 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o131 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro131 e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro132 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o123 join ro130 ro132 sinner e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro133 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o133 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro134 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o134 write e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro135 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o135 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro136 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o136 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro137 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o137 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro138 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o138 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Answer received: !yro139 (clientserver.py:512, send_command) 2025-04-02 03:02:24 [ 600 ] DEBUG : Command to send: c o139 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o100 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o70 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o72 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o73 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o74 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o75 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o76 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o78 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o79 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o80 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o81 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o82 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o83 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o85 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o86 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o87 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o88 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o90 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o91 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o92 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o93 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o94 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o95 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o96 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o97 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o98 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o99 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o101 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o103 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o105 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o113 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o119 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o126 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Command to send: m d o131 e (clientserver.py:501, send_command) 2025-04-02 03:02:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro140 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o140 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o55 range i2 i3 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro141 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ylo142 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o142 add sa e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro142 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro143 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o141 toDF ro143 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro144 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro145 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o145 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o55 range i3 i4 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro146 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ylo147 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o147 add sb e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro147 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro148 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o146 toDF ro148 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro149 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o149 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro150 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro151 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o151 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro152 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o152 get e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro153 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro154 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yao155 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o154 applyModifiableSettings ro153 ro155 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro156 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o150 cast ro156 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro157 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o149 withColumn sb ro157 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro158 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro159 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro160 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ylo161 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o161 add ro160 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro161 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro162 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro162 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro163 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o159 over ro163 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro164 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o144 withColumn srow_index ro164 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro165 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro166 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro167 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ylo168 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o168 add ro167 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro168 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro169 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro169 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro170 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o166 over ro170 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro171 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o158 withColumn srow_index ro171 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro172 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ylo173 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o173 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro173 e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro174 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o165 join ro172 ro174 sinner e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro175 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o175 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro176 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o176 write e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro177 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o177 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro178 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o178 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro179 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o179 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro180 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o180 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Answer received: !yro181 (clientserver.py:512, send_command) 2025-04-02 03:02:28 [ 600 ] DEBUG : Command to send: c o181 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o106 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o107 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o108 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o109 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o110 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o112 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o114 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o115 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o116 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o117 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o118 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o120 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o121 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o122 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o123 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o124 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o125 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o127 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o128 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o129 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o130 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o132 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o133 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o134 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o135 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o136 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o137 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o138 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o139 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o140 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o142 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o147 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o155 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o161 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o168 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o173 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o143 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o144 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o145 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o146 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o148 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o149 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o150 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o151 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o152 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o154 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o156 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o157 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o158 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o159 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o160 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o162 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o163 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o164 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o165 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o166 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o167 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o169 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o170 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o171 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o172 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o174 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o175 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o177 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o178 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o179 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Command to send: m d o180 e (clientserver.py:501, send_command) 2025-04-02 03:02:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro182 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o182 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o55 range i3 i4 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro183 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ylo184 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o184 add sa e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro184 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro185 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o183 toDF ro185 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro186 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro187 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o187 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o55 range i4 i5 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro188 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ylo189 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o189 add sb e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro189 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro190 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o188 toDF ro190 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro191 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o191 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro192 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro193 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o193 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro194 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o194 get e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro195 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro196 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yao197 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o196 applyModifiableSettings ro195 ro197 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro198 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o192 cast ro198 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro199 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o191 withColumn sb ro199 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro200 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro201 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro202 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ylo203 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o203 add ro202 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro203 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro204 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro204 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro205 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o201 over ro205 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro206 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o186 withColumn srow_index ro206 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro207 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro208 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro209 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ylo210 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o210 add ro209 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro210 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro211 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro211 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro212 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o208 over ro212 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro213 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o200 withColumn srow_index ro213 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro214 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ylo215 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o215 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro215 e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro216 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o207 join ro214 ro216 sinner e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro217 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o217 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro218 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o218 write e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro219 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o219 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro220 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o220 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro221 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o221 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro222 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o222 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Answer received: !yro223 (clientserver.py:512, send_command) 2025-04-02 03:02:32 [ 600 ] DEBUG : Command to send: c o223 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o184 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o189 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o197 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o203 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o210 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o182 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o183 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o185 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o186 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o187 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o188 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o190 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o191 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o192 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o193 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o194 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o196 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o198 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o199 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o200 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o201 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o202 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o204 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o205 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o206 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o208 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o209 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o211 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o212 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o213 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Command to send: m d o215 e (clientserver.py:501, send_command) 2025-04-02 03:02:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro224 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o224 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o55 range i4 i5 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro225 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ylo226 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o226 add sa e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro226 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro227 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o225 toDF ro227 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro228 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro229 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o229 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o55 range i5 i6 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro230 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ylo231 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o231 add sb e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro231 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro232 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o230 toDF ro232 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro233 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o233 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro234 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro235 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o235 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro236 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o236 get e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro237 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro238 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yao239 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o238 applyModifiableSettings ro237 ro239 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro240 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o234 cast ro240 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro241 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o233 withColumn sb ro241 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro242 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro243 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro244 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ylo245 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o245 add ro244 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro245 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro246 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro246 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro247 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o243 over ro247 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro248 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o228 withColumn srow_index ro248 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro249 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro250 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro251 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ylo252 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o252 add ro251 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro252 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro253 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro253 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro254 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o250 over ro254 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro255 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o242 withColumn srow_index ro255 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro256 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ylo257 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o257 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro257 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro258 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o249 join ro256 ro258 sinner e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro259 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o259 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro260 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o260 write e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro261 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o261 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro262 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o262 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro263 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o263 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro264 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o264 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yro265 (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: c o265 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o226 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o231 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o239 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o245 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o252 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o216 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o217 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o218 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o219 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o220 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o221 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o222 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o223 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o224 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o225 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o227 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o228 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o229 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o230 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o232 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o233 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o234 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o235 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o236 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o238 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o240 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o241 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o243 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o244 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o246 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o247 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o248 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Command to send: m d o257 e (clientserver.py:501, send_command) 2025-04-02 03:02:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro266 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o266 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o55 range i5 i6 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro267 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ylo268 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o268 add sa e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro268 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro269 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o267 toDF ro269 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro270 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro271 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o271 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o55 range i6 i7 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro272 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ylo273 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o273 add sb e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro273 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro274 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o272 toDF ro274 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro275 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o275 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro276 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro277 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o277 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro278 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o278 get e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro279 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro280 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yao281 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o280 applyModifiableSettings ro279 ro281 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro282 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o276 cast ro282 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro283 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o275 withColumn sb ro283 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro284 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro285 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro286 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ylo287 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o287 add ro286 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro287 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro288 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro288 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro289 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o285 over ro289 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro290 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o270 withColumn srow_index ro290 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro291 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro292 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro293 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ylo294 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o294 add ro293 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro294 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro295 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro295 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro296 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o292 over ro296 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro297 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o284 withColumn srow_index ro297 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro298 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ylo299 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o299 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro299 e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro300 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o291 join ro298 ro300 sinner e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro301 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o301 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro302 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o302 write e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro303 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o303 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro304 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o304 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro305 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o305 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro306 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o306 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Answer received: !yro307 (clientserver.py:512, send_command) 2025-04-02 03:02:39 [ 600 ] DEBUG : Command to send: c o307 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o268 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o273 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o281 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o287 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o255 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o256 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o258 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o259 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o260 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o261 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o262 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o263 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o264 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o265 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o266 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o267 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o269 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o270 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o271 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o272 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o274 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o275 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o276 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o277 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o278 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o280 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o282 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o283 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o285 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o286 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o288 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o289 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o290 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o294 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Command to send: m d o299 e (clientserver.py:501, send_command) 2025-04-02 03:02:40 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro308 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o308 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o55 range i6 i7 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro309 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ylo310 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o310 add sa e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro310 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro311 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o309 toDF ro311 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro312 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro313 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o313 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o55 range i7 i8 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro314 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ylo315 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o315 add sb e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro315 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro316 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o314 toDF ro316 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro317 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o317 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro318 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro319 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o319 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro320 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o320 get e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro321 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro322 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yao323 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o322 applyModifiableSettings ro321 ro323 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro324 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o318 cast ro324 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro325 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o317 withColumn sb ro325 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro326 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro327 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro328 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ylo329 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o329 add ro328 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro329 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro330 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro330 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro331 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o327 over ro331 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro332 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o312 withColumn srow_index ro332 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro333 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro334 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro335 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ylo336 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o336 add ro335 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro336 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro337 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro337 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro338 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o334 over ro338 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro339 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o326 withColumn srow_index ro339 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro340 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ylo341 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o341 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro341 e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro342 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o333 join ro340 ro342 sinner e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro343 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o343 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro344 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o344 write e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro345 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o345 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro346 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o346 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro347 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o347 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro348 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o348 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Answer received: !yro349 (clientserver.py:512, send_command) 2025-04-02 03:02:42 [ 600 ] DEBUG : Command to send: c o349 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o310 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o315 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o323 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o329 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o295 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o296 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o297 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o298 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o300 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o301 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o302 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o303 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o304 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o305 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o306 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o307 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o308 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o309 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o311 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o313 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o314 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o316 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o317 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o318 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o319 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o320 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o322 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o324 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o325 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o328 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o330 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o336 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Command to send: m d o341 e (clientserver.py:501, send_command) 2025-04-02 03:02:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro350 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o350 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o55 range i7 i8 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro351 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ylo352 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o352 add sa e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro352 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro353 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o351 toDF ro353 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro354 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro355 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o355 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o55 range i8 i9 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro356 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ylo357 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o357 add sb e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro357 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro358 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o356 toDF ro358 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro359 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o359 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro360 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro361 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o361 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro362 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o362 get e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro363 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro364 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yao365 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o364 applyModifiableSettings ro363 ro365 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro366 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o360 cast ro366 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro367 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o359 withColumn sb ro367 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro368 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro369 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro370 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ylo371 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o371 add ro370 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro371 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro372 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro372 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro373 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o369 over ro373 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro374 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o354 withColumn srow_index ro374 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro375 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro376 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro377 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ylo378 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o378 add ro377 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro378 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro379 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro379 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro380 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o376 over ro380 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro381 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o368 withColumn srow_index ro381 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro382 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ylo383 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o383 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro383 e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro384 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o375 join ro382 ro384 sinner e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro385 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o385 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro386 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o386 write e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro387 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o387 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro388 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o388 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro389 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o389 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro390 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o390 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Answer received: !yro391 (clientserver.py:512, send_command) 2025-04-02 03:02:45 [ 600 ] DEBUG : Command to send: c o391 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o352 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o357 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o365 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o332 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o333 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o334 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o335 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o337 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o338 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o339 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o340 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o342 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o343 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o344 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o345 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o346 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o347 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o348 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o349 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o350 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o351 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o353 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o355 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o356 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o358 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o359 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o360 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o361 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o362 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o364 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o366 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o367 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o371 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o378 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Command to send: m d o383 e (clientserver.py:501, send_command) 2025-04-02 03:02:46 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro392 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o392 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o55 range i8 i9 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro393 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ylo394 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o394 add sa e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro394 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro395 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o393 toDF ro395 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro396 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro397 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o397 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o55 range i9 i10 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro398 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ylo399 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o399 add sb e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro399 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro400 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o398 toDF ro400 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro401 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o401 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro402 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro403 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o403 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro404 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o404 get e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro405 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro406 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yao407 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o406 applyModifiableSettings ro405 ro407 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro408 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o402 cast ro408 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro409 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o401 withColumn sb ro409 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro410 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro411 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro412 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ylo413 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o413 add ro412 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro413 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro414 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro414 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro415 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o411 over ro415 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro416 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o396 withColumn srow_index ro416 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro417 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro418 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro419 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ylo420 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o420 add ro419 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro420 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro421 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro421 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro422 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o418 over ro422 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro423 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o410 withColumn srow_index ro423 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro424 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ylo425 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o425 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro425 e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro426 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o417 join ro424 ro426 sinner e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro427 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o427 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro428 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o428 write e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro429 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o429 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro430 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o430 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro431 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o431 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro432 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o432 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Answer received: !yro433 (clientserver.py:512, send_command) 2025-04-02 03:02:48 [ 600 ] DEBUG : Command to send: c o433 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o394 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o399 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o407 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o372 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o373 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o374 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o375 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o376 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o377 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o379 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o380 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o381 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o382 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o384 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o385 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o386 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o387 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o388 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o389 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o390 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o391 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o392 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o393 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o395 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o397 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o398 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o400 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o403 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o404 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o406 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o413 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o420 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Command to send: m d o425 e (clientserver.py:501, send_command) 2025-04-02 03:02:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro434 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o434 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o55 range i9 i10 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro435 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ylo436 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o436 add sa e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro436 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro437 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o435 toDF ro437 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro438 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro439 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o439 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o55 range i10 i11 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro440 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ylo441 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o441 add sb e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro441 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro442 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o440 toDF ro442 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro443 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o443 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro444 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro445 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o445 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro446 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o446 get e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro447 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro448 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yao449 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o448 applyModifiableSettings ro447 ro449 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro450 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o444 cast ro450 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro451 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o443 withColumn sb ro451 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro452 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro453 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro454 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ylo455 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o455 add ro454 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro455 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro456 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro456 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro457 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o453 over ro457 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro458 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o438 withColumn srow_index ro458 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro459 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro460 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro461 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ylo462 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o462 add ro461 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro462 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro463 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro463 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro464 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o460 over ro464 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro465 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o452 withColumn srow_index ro465 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro466 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ylo467 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o467 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro467 e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro468 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o459 join ro466 ro468 sinner e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro469 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o469 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro470 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o470 write e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro471 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o471 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro472 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o472 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro473 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o473 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro474 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o474 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Answer received: !yro475 (clientserver.py:512, send_command) 2025-04-02 03:02:51 [ 600 ] DEBUG : Command to send: c o475 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o436 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o441 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o409 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o410 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o411 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o412 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o414 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o415 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o416 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o417 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o418 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o419 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o421 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o422 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o423 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o424 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o426 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o427 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o428 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o429 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o430 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o431 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o432 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o433 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o434 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o435 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o437 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o439 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o440 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o442 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o445 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o449 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o455 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o462 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Command to send: m d o467 e (clientserver.py:501, send_command) 2025-04-02 03:02:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro476 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o476 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o55 range i10 i11 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro477 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ylo478 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o478 add sa e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro478 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro479 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o477 toDF ro479 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro480 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro481 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o481 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o55 range i11 i12 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro482 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ylo483 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o483 add sb e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro483 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro484 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o482 toDF ro484 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro485 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o485 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro486 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro487 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o487 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro488 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o488 get e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro489 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro490 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yao491 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o490 applyModifiableSettings ro489 ro491 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro492 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o486 cast ro492 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro493 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o485 withColumn sb ro493 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro494 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro495 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro496 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ylo497 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o497 add ro496 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro497 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro498 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro498 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro499 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o495 over ro499 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro500 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o480 withColumn srow_index ro500 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro501 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro502 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro503 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ylo504 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o504 add ro503 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro504 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro505 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro505 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro506 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o502 over ro506 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro507 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o494 withColumn srow_index ro507 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro508 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ylo509 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o509 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro509 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro510 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o501 join ro508 ro510 sinner e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro511 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o511 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro512 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o512 write e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro513 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o513 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro514 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o514 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro515 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o515 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro516 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o516 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yro517 (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: c o517 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o478 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o69 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o60 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o65 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o66 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o102 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o104 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o141 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o111 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o181 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o176 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o153 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o207 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o214 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o195 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o253 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o254 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o242 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o249 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o251 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o250 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o237 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o284 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o291 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o293 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o292 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o279 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o331 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o312 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o326 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o327 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o321 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o354 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o368 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o370 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o369 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o363 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o408 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o396 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o401 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o402 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o405 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o438 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o443 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o444 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o446 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o448 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o450 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o451 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o452 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o453 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o454 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o456 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o457 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o458 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o459 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o460 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o461 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o463 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o464 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o465 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o466 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o468 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o469 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o470 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o471 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o472 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o473 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o474 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o475 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o476 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o477 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o479 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o481 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o483 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o491 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o497 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o504 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o509 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o484 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o485 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o486 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o487 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o488 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o490 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o492 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o493 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o494 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o495 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o496 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o498 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o499 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o500 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o501 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o502 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o503 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o505 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o506 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o507 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o508 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o510 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o511 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o513 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o514 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o515 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Command to send: m d o516 e (clientserver.py:501, send_command) 2025-04-02 03:02:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro518 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o518 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o55 range i11 i12 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro519 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ylo520 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o520 add sa e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro520 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro521 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o519 toDF ro521 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro522 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro523 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o523 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o55 range i12 i13 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro524 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ylo525 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o525 add sb e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro525 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro526 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o524 toDF ro526 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro527 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o527 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro528 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro529 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o529 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro530 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o530 get e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro531 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro532 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yao533 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o532 applyModifiableSettings ro531 ro533 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro534 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o528 cast ro534 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro535 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o527 withColumn sb ro535 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro536 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro537 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro538 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ylo539 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o539 add ro538 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro539 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro540 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro540 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro541 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o537 over ro541 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro542 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o522 withColumn srow_index ro542 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro543 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro544 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro545 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ylo546 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o546 add ro545 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro546 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro547 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro547 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro548 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o544 over ro548 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro549 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o536 withColumn srow_index ro549 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro550 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ylo551 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o551 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro551 e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro552 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o543 join ro550 ro552 sinner e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro553 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o553 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro554 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o554 write e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro555 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o555 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro556 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o556 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro557 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o557 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro558 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o558 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Answer received: !yro559 (clientserver.py:512, send_command) 2025-04-02 03:02:59 [ 600 ] DEBUG : Command to send: c o559 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o520 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o525 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o533 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o539 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o518 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o519 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o521 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o522 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o523 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o524 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o526 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o527 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o528 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o529 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o530 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o532 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o534 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o535 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o537 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o538 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o540 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o541 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o542 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o546 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Command to send: m d o551 e (clientserver.py:501, send_command) 2025-04-02 03:03:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:02 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:02 [ 600 ] DEBUG : Answer received: !yro560 (clientserver.py:512, send_command) 2025-04-02 03:03:02 [ 600 ] DEBUG : Command to send: c o560 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:02 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:02 [ 600 ] DEBUG : Command to send: c o55 range i12 i13 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro561 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ylo562 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o562 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro562 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro563 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o561 toDF ro563 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro564 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro565 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o565 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o55 range i13 i14 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro566 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ylo567 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o567 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro567 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro568 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o566 toDF ro568 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro569 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o569 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro570 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro571 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o571 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro572 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o572 get e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro573 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro574 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yao575 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o574 applyModifiableSettings ro573 ro575 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro576 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o570 cast ro576 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro577 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o569 withColumn sb ro577 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro578 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro579 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro580 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ylo581 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o581 add ro580 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro581 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro582 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro582 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro583 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o579 over ro583 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro584 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o564 withColumn srow_index ro584 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro585 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro586 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro587 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ylo588 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o588 add ro587 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro588 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro589 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro589 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro590 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o586 over ro590 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro591 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o578 withColumn srow_index ro591 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro592 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ylo593 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o593 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro593 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro594 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o585 join ro592 ro594 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro595 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o595 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro596 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o596 write e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro597 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o597 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro598 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o598 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro599 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o599 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro600 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o600 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yro601 (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: c o601 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o562 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o567 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o575 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o581 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o547 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o548 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o549 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o550 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o552 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o553 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o554 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o555 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o556 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o557 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o558 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o559 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o560 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o561 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o563 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o564 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o565 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o566 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o568 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o569 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o570 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o571 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o572 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o574 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o576 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o577 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o579 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o580 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o582 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o583 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o584 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o588 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Command to send: m d o593 e (clientserver.py:501, send_command) 2025-04-02 03:03:03 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro602 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o602 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o55 range i13 i14 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro603 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ylo604 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o604 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro604 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro605 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o603 toDF ro605 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro606 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro607 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o607 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o55 range i14 i15 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro608 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ylo609 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o609 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro609 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro610 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o608 toDF ro610 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro611 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o611 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro612 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro613 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o613 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro614 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o614 get e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro615 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro616 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yao617 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o616 applyModifiableSettings ro615 ro617 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro618 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o612 cast ro618 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro619 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o611 withColumn sb ro619 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro620 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro621 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro622 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ylo623 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o623 add ro622 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro623 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro624 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro624 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro625 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o621 over ro625 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro626 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o606 withColumn srow_index ro626 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro627 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro628 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro629 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ylo630 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o630 add ro629 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro630 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro631 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro631 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro632 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o628 over ro632 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro633 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o620 withColumn srow_index ro633 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro634 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ylo635 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o635 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro635 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro636 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o627 join ro634 ro636 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro637 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o637 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro638 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o638 write e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro639 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o639 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro640 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o640 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro641 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o641 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro642 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o642 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yro643 (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: c o643 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o604 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o609 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o617 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o623 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o589 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o590 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o591 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o592 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o594 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o595 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o596 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o597 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o598 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o599 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o600 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o601 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o602 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o603 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o605 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o607 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o608 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o610 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o611 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o612 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o613 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o614 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o616 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o618 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o619 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o622 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o624 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o630 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Command to send: m d o635 e (clientserver.py:501, send_command) 2025-04-02 03:03:06 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro644 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o644 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o55 range i14 i15 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro645 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ylo646 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o646 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro646 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro647 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o645 toDF ro647 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro648 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro649 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o649 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o55 range i15 i16 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro650 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ylo651 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o651 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro651 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro652 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o650 toDF ro652 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro653 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o653 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro654 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro655 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o655 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro656 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o656 get e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro657 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro658 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yao659 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o658 applyModifiableSettings ro657 ro659 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro660 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o654 cast ro660 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro661 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o653 withColumn sb ro661 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro662 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro663 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro664 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ylo665 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o665 add ro664 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro665 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro666 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro666 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro667 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o663 over ro667 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro668 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o648 withColumn srow_index ro668 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro669 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro670 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro671 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ylo672 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o672 add ro671 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro672 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro673 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro673 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro674 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o670 over ro674 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro675 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o662 withColumn srow_index ro675 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro676 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ylo677 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o677 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro677 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro678 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o669 join ro676 ro678 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro679 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o679 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro680 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o680 write e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro681 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o681 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro682 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o682 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro683 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o683 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro684 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o684 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yro685 (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: c o685 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o646 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o651 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o659 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o627 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o628 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o629 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o631 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o632 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o633 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o634 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o636 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o637 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o638 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o639 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o640 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o641 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o642 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o643 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o644 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o645 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o647 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o649 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o650 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o652 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o653 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o654 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o655 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o656 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o658 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o660 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o661 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o665 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o672 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Command to send: m d o677 e (clientserver.py:501, send_command) 2025-04-02 03:03:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro686 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o686 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o55 range i15 i16 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro687 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ylo688 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o688 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro688 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro689 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o687 toDF ro689 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro690 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro691 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o691 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o55 range i16 i17 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro692 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ylo693 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o693 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro693 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro694 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o692 toDF ro694 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro695 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o695 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro696 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro697 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o697 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro698 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o698 get e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro699 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro700 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yao701 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o700 applyModifiableSettings ro699 ro701 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro702 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o696 cast ro702 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro703 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o695 withColumn sb ro703 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro704 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro705 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro706 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ylo707 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o707 add ro706 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro707 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro708 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro708 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro709 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o705 over ro709 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro710 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o690 withColumn srow_index ro710 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro711 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro712 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro713 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ylo714 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o714 add ro713 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro714 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro715 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro715 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro716 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o712 over ro716 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro717 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o704 withColumn srow_index ro717 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro718 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ylo719 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o719 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro719 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro720 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o711 join ro718 ro720 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro721 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o721 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro722 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o722 write e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro723 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o723 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro724 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o724 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro725 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o725 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro726 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o726 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yro727 (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: c o727 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o688 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o693 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o701 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o666 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o667 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o668 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o669 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o670 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o671 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o673 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o674 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o675 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o676 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o678 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o679 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o680 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o681 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o682 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o683 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o684 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o685 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o686 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o687 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o689 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o691 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o692 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o694 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o695 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o696 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o697 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o698 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o700 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o702 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o703 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o707 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o714 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Command to send: m d o719 e (clientserver.py:501, send_command) 2025-04-02 03:03:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro728 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o728 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o55 range i16 i17 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro729 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ylo730 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o730 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro730 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro731 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o729 toDF ro731 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro732 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro733 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o733 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o55 range i17 i18 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro734 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ylo735 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o735 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro735 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro736 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o734 toDF ro736 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro737 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o737 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro738 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro739 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o739 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro740 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o740 get e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro741 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro742 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yao743 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o742 applyModifiableSettings ro741 ro743 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro744 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o738 cast ro744 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro745 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o737 withColumn sb ro745 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro746 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro747 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro748 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ylo749 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o749 add ro748 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro749 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro750 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro750 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro751 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o747 over ro751 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro752 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o732 withColumn srow_index ro752 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro753 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro754 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro755 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ylo756 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o756 add ro755 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro756 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro757 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro757 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro758 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o754 over ro758 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro759 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o746 withColumn srow_index ro759 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro760 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ylo761 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o761 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro761 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro762 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o753 join ro760 ro762 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro763 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o763 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro764 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o764 write e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro765 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o765 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro766 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o766 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro767 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o767 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro768 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o768 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yro769 (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: c o769 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o730 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o735 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o705 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o706 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o708 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o709 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o710 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o711 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o712 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o713 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o715 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o716 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o717 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o718 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o720 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o721 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o722 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o723 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o724 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o725 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o726 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o727 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o728 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o729 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o731 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o733 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o734 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o736 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o739 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o743 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o749 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o756 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Command to send: m d o761 e (clientserver.py:501, send_command) 2025-04-02 03:03:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro770 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o770 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o55 range i17 i18 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro771 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ylo772 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o772 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro772 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro773 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o771 toDF ro773 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro774 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro775 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o775 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o55 range i18 i19 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro776 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ylo777 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o777 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro777 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro778 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o776 toDF ro778 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro779 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o779 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro780 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro781 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o781 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro782 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o782 get e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro783 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro784 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yao785 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o784 applyModifiableSettings ro783 ro785 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro786 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o780 cast ro786 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro787 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o779 withColumn sb ro787 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro788 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro789 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro790 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ylo791 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o791 add ro790 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro791 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro792 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro792 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro793 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o789 over ro793 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro794 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o774 withColumn srow_index ro794 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro795 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro796 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro797 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ylo798 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o798 add ro797 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro798 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro799 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro799 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro800 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o796 over ro800 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro801 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o788 withColumn srow_index ro801 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro802 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ylo803 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o803 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro803 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro804 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o795 join ro802 ro804 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro805 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o805 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro806 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o806 write e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro807 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o807 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro808 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o808 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro809 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o809 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro810 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o810 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yro811 (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: c o811 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o772 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o777 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o742 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o744 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o745 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o746 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o747 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o748 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o750 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o751 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o752 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o753 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o754 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o755 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o757 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o758 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o759 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o760 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o762 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o763 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o764 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o765 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o766 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o767 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o768 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o769 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o770 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o771 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o773 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o775 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o776 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o778 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o785 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o791 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o798 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Command to send: m d o803 e (clientserver.py:501, send_command) 2025-04-02 03:03:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro812 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o812 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o55 range i18 i19 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro813 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ylo814 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o814 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro814 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro815 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o813 toDF ro815 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro816 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro817 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o817 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o55 range i19 i20 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro818 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ylo819 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o819 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro819 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro820 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o818 toDF ro820 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro821 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o821 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro822 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro823 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o823 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro824 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o824 get e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro825 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro826 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yao827 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o826 applyModifiableSettings ro825 ro827 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro828 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o822 cast ro828 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro829 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o821 withColumn sb ro829 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro830 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro831 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro832 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ylo833 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o833 add ro832 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro833 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro834 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro834 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro835 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o831 over ro835 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro836 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o816 withColumn srow_index ro836 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro837 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro838 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro839 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ylo840 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o840 add ro839 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro840 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro841 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro841 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro842 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o838 over ro842 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro843 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o830 withColumn srow_index ro843 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro844 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ylo845 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o845 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro845 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro846 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o837 join ro844 ro846 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro847 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o847 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro848 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o848 write e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro849 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o849 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro850 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o850 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro851 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o851 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro852 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o852 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yro853 (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: c o853 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o814 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o780 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o781 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o782 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o784 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o786 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o787 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o788 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o789 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o790 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o792 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o793 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o794 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o795 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o796 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o797 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o799 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o800 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o801 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o802 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o804 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o805 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o806 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o807 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o808 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o809 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o810 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o811 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o812 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o813 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o815 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o819 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o827 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o833 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o840 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Command to send: m d o845 e (clientserver.py:501, send_command) 2025-04-02 03:03:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro854 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o854 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o55 range i19 i20 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro855 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ylo856 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o856 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro856 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro857 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o855 toDF ro857 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro858 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro859 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o859 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o55 range i20 i21 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro860 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ylo861 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o861 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro861 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro862 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o860 toDF ro862 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro863 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o863 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro864 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro865 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o865 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro866 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o866 get e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro867 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro868 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yao869 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o868 applyModifiableSettings ro867 ro869 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro870 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o864 cast ro870 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro871 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o863 withColumn sb ro871 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro872 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro873 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro874 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ylo875 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o875 add ro874 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro875 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro876 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro876 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro877 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o873 over ro877 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro878 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o858 withColumn srow_index ro878 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro879 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro880 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro881 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ylo882 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o882 add ro881 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro882 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro883 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro883 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro884 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o880 over ro884 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro885 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o872 withColumn srow_index ro885 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro886 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ylo887 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o887 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro887 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro888 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o879 join ro886 ro888 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro889 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o889 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro890 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o890 write e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro891 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o891 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro892 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o892 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro893 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o893 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro894 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o894 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yro895 (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: c o895 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o818 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o820 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o821 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o822 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o823 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o824 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o826 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o828 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o829 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o830 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o831 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o832 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o834 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o835 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o836 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o837 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o838 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o839 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o841 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o842 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o843 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o844 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o846 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o847 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o848 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o849 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o850 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o851 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o852 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o853 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o856 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o861 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o869 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o875 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o882 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o887 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o855 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o857 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o858 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o859 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o860 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o862 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o863 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o864 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o865 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o866 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o868 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o870 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o871 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o872 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o873 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o874 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o876 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o877 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o878 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o879 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o880 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o881 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o883 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o884 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o885 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o886 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o888 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o889 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o891 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o892 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o893 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Command to send: m d o894 e (clientserver.py:501, send_command) 2025-04-02 03:03:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro896 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o896 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o55 range i20 i21 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro897 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ylo898 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o898 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro898 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro899 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o897 toDF ro899 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro900 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro901 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o901 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o55 range i21 i22 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro902 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ylo903 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o903 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro903 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro904 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o902 toDF ro904 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro905 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o905 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro906 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro907 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o907 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro908 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o908 get e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro909 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro910 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yao911 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o910 applyModifiableSettings ro909 ro911 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro912 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o906 cast ro912 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro913 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o905 withColumn sb ro913 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro914 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro915 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro916 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ylo917 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o917 add ro916 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro917 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro918 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro918 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro919 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o915 over ro919 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro920 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o900 withColumn srow_index ro920 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro921 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro922 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro923 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ylo924 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o924 add ro923 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro924 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro925 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro925 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro926 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o922 over ro926 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro927 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o914 withColumn srow_index ro927 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro928 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ylo929 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o929 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro929 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro930 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o921 join ro928 ro930 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro931 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o931 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro932 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o932 write e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro933 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o933 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro934 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o934 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro935 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o935 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro936 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o936 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yro937 (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: c o937 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o898 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o903 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o911 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o917 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o924 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o517 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o512 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o489 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o545 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o536 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o543 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o544 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o531 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o578 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o585 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o587 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o586 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o573 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o625 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o626 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o606 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o620 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o621 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o615 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o648 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o662 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o664 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o663 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o657 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o690 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o704 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o699 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o732 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o737 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o738 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o740 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o774 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o779 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o741 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o817 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o816 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o783 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o854 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o825 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o895 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o890 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o867 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o896 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o897 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o899 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o900 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o901 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o902 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o904 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o905 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o906 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o907 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o908 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o910 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o912 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o913 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o914 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o915 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o916 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o918 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o919 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o920 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o922 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o923 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o925 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o926 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o927 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Command to send: m d o929 e (clientserver.py:501, send_command) 2025-04-02 03:03:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro938 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o938 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o55 range i21 i22 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro939 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ylo940 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o940 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro940 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro941 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o939 toDF ro941 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro942 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro943 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o943 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o55 range i22 i23 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro944 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ylo945 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o945 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro945 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro946 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o944 toDF ro946 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro947 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o947 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro948 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro949 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o949 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro950 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o950 get e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro951 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro952 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yao953 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o952 applyModifiableSettings ro951 ro953 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro954 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o948 cast ro954 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro955 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o947 withColumn sb ro955 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro956 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro957 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro958 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ylo959 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o959 add ro958 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro959 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro960 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro960 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro961 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o957 over ro961 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro962 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o942 withColumn srow_index ro962 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro963 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro964 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro965 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ylo966 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o966 add ro965 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro966 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro967 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro967 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro968 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o964 over ro968 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro969 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o956 withColumn srow_index ro969 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro970 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ylo971 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o971 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro971 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro972 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o963 join ro970 ro972 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro973 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o973 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro974 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o974 write e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro975 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o975 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro976 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o976 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro977 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o977 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro978 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o978 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yro979 (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: c o979 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o940 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o945 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o953 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o930 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o931 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o932 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o933 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o934 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o935 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o936 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o937 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o938 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o939 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o941 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o943 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o944 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o946 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o947 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o948 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o949 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o950 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o952 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o954 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o955 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o959 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o966 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Command to send: m d o971 e (clientserver.py:501, send_command) 2025-04-02 03:03:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro980 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o980 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o55 range i22 i23 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro981 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ylo982 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o982 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro982 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro983 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o981 toDF ro983 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro984 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro985 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o985 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o55 range i23 i24 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro986 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ylo987 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o987 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro987 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro988 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o986 toDF ro988 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro989 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o989 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro990 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro991 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o991 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro992 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o992 get e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro993 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro994 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yao995 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o994 applyModifiableSettings ro993 ro995 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro996 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o990 cast ro996 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro997 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o989 withColumn sb ro997 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro998 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro999 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1000 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ylo1001 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o1001 add ro1000 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1001 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1002 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1002 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1003 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o999 over ro1003 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1004 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o984 withColumn srow_index ro1004 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1005 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1006 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1007 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ylo1008 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o1008 add ro1007 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1008 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1009 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1009 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1010 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o1006 over ro1010 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1011 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o998 withColumn srow_index ro1011 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1012 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ylo1013 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o1013 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1013 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1014 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o1005 join ro1012 ro1014 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1015 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o1015 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1016 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o1016 write e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1017 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o1017 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1018 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o1018 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1019 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o1019 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1020 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o1020 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yro1021 (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: c o1021 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o982 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o987 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o995 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o960 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o961 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o962 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o963 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o964 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o965 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o967 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o968 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o969 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o970 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o972 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o973 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o974 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o975 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o976 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o977 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o978 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o979 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o980 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o981 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o983 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o985 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o986 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o988 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o989 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o990 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o991 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o992 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o994 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o996 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o997 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o1001 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o1008 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Command to send: m d o1013 e (clientserver.py:501, send_command) 2025-04-02 03:03:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1022 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1022 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o55 range i23 i24 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1023 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ylo1024 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1024 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1024 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1025 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1023 toDF ro1025 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1026 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1027 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1027 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o55 range i24 i25 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1028 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ylo1029 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1029 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1029 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1030 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1028 toDF ro1030 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1031 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1031 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1032 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1033 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1033 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1034 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1034 get e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1035 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1036 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yao1037 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1036 applyModifiableSettings ro1035 ro1037 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1038 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1032 cast ro1038 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1039 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1031 withColumn sb ro1039 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1040 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1041 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1042 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ylo1043 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1043 add ro1042 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1043 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1044 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1044 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1045 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1041 over ro1045 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1046 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1026 withColumn srow_index ro1046 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1047 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1048 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1049 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ylo1050 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1050 add ro1049 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1050 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1051 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1051 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1052 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1048 over ro1052 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1053 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1040 withColumn srow_index ro1053 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1054 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ylo1055 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1055 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1055 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1056 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1047 join ro1054 ro1056 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1057 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1057 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1058 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1058 write e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1059 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1059 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1060 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1060 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1061 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1061 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1062 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1062 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yro1063 (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: c o1063 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1024 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1029 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1000 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1002 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1003 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1004 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1005 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1006 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1007 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1009 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1010 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1011 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1012 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1014 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1015 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1016 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1017 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1018 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1019 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1020 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1021 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1022 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1023 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1025 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1027 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1028 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1030 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1033 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1034 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1037 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1043 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1050 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Command to send: m d o1055 e (clientserver.py:501, send_command) 2025-04-02 03:03:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1064 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1064 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o55 range i24 i25 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1065 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ylo1066 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1066 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1066 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1067 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1065 toDF ro1067 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1068 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1069 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1069 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o55 range i25 i26 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1070 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ylo1071 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1071 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1071 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1072 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1070 toDF ro1072 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1073 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1073 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1074 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1075 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1075 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1076 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1076 get e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1077 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1078 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yao1079 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1078 applyModifiableSettings ro1077 ro1079 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1080 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1074 cast ro1080 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1081 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1073 withColumn sb ro1081 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1082 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1083 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1084 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ylo1085 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1085 add ro1084 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1085 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1086 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1086 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1087 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1083 over ro1087 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1088 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1068 withColumn srow_index ro1088 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1089 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1090 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1091 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ylo1092 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1092 add ro1091 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1092 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1093 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1093 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1094 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1090 over ro1094 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1095 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1082 withColumn srow_index ro1095 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1096 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ylo1097 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1097 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1097 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1098 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1089 join ro1096 ro1098 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1099 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1099 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1100 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1100 write e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1101 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1101 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1102 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1102 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1103 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1103 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1104 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1104 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yro1105 (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: c o1105 save s/test_checkpointyQ4gqOphBu e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1066 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1071 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1038 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1039 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1040 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1041 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1042 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1044 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1045 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1046 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1047 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1048 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1049 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1051 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1052 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1053 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1054 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1056 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1057 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1058 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1059 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1060 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1061 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1062 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1063 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1064 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1065 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1067 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1069 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1070 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1072 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1079 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1085 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1092 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Command to send: m d o1097 e (clientserver.py:501, send_command) 2025-04-02 03:03:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Resetting dropped connection: 172.16.1.8 (connectionpool.py:293, _get_conn) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-715ba256-2489-40f3-b788-8dcf8408d9ac-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-63f6f782-4731-4a5c-afe5-6fda4821724b-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-28394a75-bf26-4a13-a8e1-341183f647d1-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-e0531564-d285-4a6a-a3c0-479f7c985644-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-e0a69ff1-c511-42fb-8966-405e5528de82-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-d98e43ee-a726-4be9-8e15-cdbe01fde9b1-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-92246f56-511b-48e0-8226-fc066bad072a-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-c38e5607-41fb-4373-8df0-6a6ab28a822e-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-7f5ac482-d50f-4560-9261-9001acc90513-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-814c477d-6056-47a7-bf61-fa9efa5a4cae-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-fec41f10-d9ce-45c1-a7c9-9cd164e25e6a-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-43016ac0-7832-4c61-8642-6fd685a5d165-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000016.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000007.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000003.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000010.checkpoint.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000008.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000021.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000001.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000020.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000013.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000004.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000020.checkpoint.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000002.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000014.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000017.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000022.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000012.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000005.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000015.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000024.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000006.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000009.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/_last_checkpoint HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000011.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000023.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000010.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000018.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/_delta_log/00000000000000000019.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-0762f1e9-7286-40bc-b8d7-f81ac7277136-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-50fd7259-ca00-4c41-b9b8-496356389bee-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-05bf258b-e5c8-4b07-a1cb-fd959a734678-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-b03cbc61-fbd1-4c61-a4e4-a9bd3462a95e-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-fe3c9f6b-9fbd-4e26-97f7-aa734c056043-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-8e611485-32ea-4d40-8f2c-c98b9c4c684f-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-0b937465-d1be-418c-b52e-c7032b95eb7a-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-997f0781-428e-4efc-a530-244a87443d21-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-179bbbd4-7fdf-4e6a-a1b6-0d90f8384408-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-33bbc2fa-faa2-4c79-b716-62b793632b35-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-4c32137b-54de-475e-8ef3-36a639105c33-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-37afed33-0e69-4633-9f02-a48b114f188d-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointyQ4gqOphBu/part-00000-30b619eb-62c4-4a03-bc3c-507cce35ff2b-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:03:44 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_checkpointyQ4gqOphBu; CREATE TABLE test_checkpointyQ4gqOphBu ENGINE=DeltaLake(s3, filename = 'test_checkpointyQ4gqOphBu/', url = 'http://minio1:9001/root/') SETTINGS allow_experimental_delta_kernel_rs=0 on node1 (cluster.py:3564, query) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1075 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1076 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1078 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1080 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1081 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1082 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1083 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1084 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1086 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1087 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1088 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1089 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1090 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1091 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1093 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1094 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1095 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1096 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1098 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1099 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1100 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1101 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1102 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1103 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1104 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Command to send: m d o1105 e (clientserver.py:501, send_command) 2025-04-02 03:03:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) ______________________________ test_checkpoint[1] ______________________________ started_cluster = use_delta_kernel = '1' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_checkpoint(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket TABLE_NAME = randomize_table_name("test_checkpoint") write_delta_from_df( spark, generate_data(spark, 0, 1), f"/{TABLE_NAME}", mode="overwrite", ) for i in range(1, 25): write_delta_from_df( spark, generate_data(spark, i, i + 1), f"/{TABLE_NAME}", mode="append", ) files = upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") # 25 data files # 25 metadata files # 1 last_metadata file # 2 checkpoints assert len(files) == 25 * 2 + 3 ok = False for file in files: if file.endswith("last_checkpoint"): ok = True assert ok > create_delta_table(instance, TABLE_NAME, use_delta_kernel=use_delta_kernel) test_storage_delta/test.py:262: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_delta/test.py:152: in create_delta_table node.query( helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 56, stderr: Received exception from server (version 25.2.2): E Code: 56. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table engine DeltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Storages/StorageFactory.cpp:276: DB::StorageFactory::getStorageFeatures(String const&) const @ 0x000000002d62e3cc E 5. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:105: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr const&, std::shared_ptr) @ 0x000000002995251c E 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1124: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a015adc E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 8. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 9. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 11. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 13. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 14. asan_thread_start(void*) @ 0x000000000b6a3e77 E 15. ? @ 0x00007fa1c9941ac3 E 16. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_STORAGE) E (query: CREATE TABLE test_checkpointZ068HGYnLH E ENGINE=DeltaLake(s3, filename = 'test_checkpointZ068HGYnLH/', url = 'http://minio1:9001/root/') E SETTINGS allow_experimental_delta_kernel_rs=1) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1106 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1106 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o55 range i0 i1 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1107 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ylo1108 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1108 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1108 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1109 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1107 toDF ro1109 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1110 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1111 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1111 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o55 range i1 i2 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1112 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ylo1113 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1113 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1113 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1114 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1112 toDF ro1114 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1115 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1115 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1116 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1117 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1117 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1118 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1118 get e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1119 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1120 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yao1121 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1120 applyModifiableSettings ro1119 ro1121 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1122 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1116 cast ro1122 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1123 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1115 withColumn sb ro1123 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1124 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1125 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1126 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ylo1127 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1127 add ro1126 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1127 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1128 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1128 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1129 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1125 over ro1129 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1130 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1110 withColumn srow_index ro1130 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1131 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1132 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1133 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ylo1134 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1134 add ro1133 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1134 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1135 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1135 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1136 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1132 over ro1136 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1137 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1124 withColumn srow_index ro1137 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1138 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ylo1139 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1139 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1139 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1140 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1131 join ro1138 ro1140 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1141 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1141 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1142 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1142 write e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1143 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1143 mode soverwrite e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1144 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1144 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1145 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1145 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1146 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1146 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yro1147 (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: c o1147 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o942 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o956 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o958 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o957 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o951 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o984 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o998 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o999 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o993 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1035 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1026 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1031 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1032 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1036 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1068 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1073 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1074 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1108 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1113 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1121 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1127 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1134 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1139 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1106 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1107 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1109 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1110 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1111 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1112 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1114 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1115 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1116 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1117 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1118 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1120 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1122 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1123 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1124 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1125 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1126 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1128 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1129 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1130 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1131 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1132 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1133 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1135 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1136 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1137 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1138 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1140 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1141 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Command to send: m d o1143 e (clientserver.py:501, send_command) 2025-04-02 03:03:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1148 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1148 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o55 range i1 i2 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1149 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ylo1150 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1150 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1150 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1151 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1149 toDF ro1151 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1152 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1153 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1153 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o55 range i2 i3 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1154 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ylo1155 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1155 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1155 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1156 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1154 toDF ro1156 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1157 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1157 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1158 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1159 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1159 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1160 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1160 get e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1161 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1162 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yao1163 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1162 applyModifiableSettings ro1161 ro1163 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1164 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1158 cast ro1164 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1165 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1157 withColumn sb ro1165 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1166 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1167 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1168 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ylo1169 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1169 add ro1168 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1169 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1170 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1170 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1171 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1167 over ro1171 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1172 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1152 withColumn srow_index ro1172 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1173 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1174 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1175 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ylo1176 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1176 add ro1175 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1176 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1177 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1177 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1178 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1174 over ro1178 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1179 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1166 withColumn srow_index ro1179 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1180 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ylo1181 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1181 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1181 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1182 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1173 join ro1180 ro1182 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1183 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1183 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1184 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1184 write e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1185 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1185 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1186 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1186 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1187 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1187 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1188 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1188 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yro1189 (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: c o1189 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1150 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1155 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1163 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1169 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1145 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1146 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1147 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1148 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1149 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1151 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1152 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1153 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1154 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1156 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1157 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1158 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1159 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1160 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1162 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1164 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1165 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1167 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1168 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1170 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1171 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1172 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1176 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Command to send: m d o1181 e (clientserver.py:501, send_command) 2025-04-02 03:03:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1190 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1190 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o55 range i2 i3 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1191 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ylo1192 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1192 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1192 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1193 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1191 toDF ro1193 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1194 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1195 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1195 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o55 range i3 i4 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1196 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ylo1197 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1197 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1197 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1198 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1196 toDF ro1198 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1199 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1199 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1200 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1201 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1201 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1202 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1202 get e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1203 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1204 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yao1205 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1204 applyModifiableSettings ro1203 ro1205 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1206 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1200 cast ro1206 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1207 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1199 withColumn sb ro1207 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1208 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1209 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1210 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ylo1211 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1211 add ro1210 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1211 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1212 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1212 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1213 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1209 over ro1213 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1214 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1194 withColumn srow_index ro1214 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1215 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1216 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1217 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ylo1218 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1218 add ro1217 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1218 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1219 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1219 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1220 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1216 over ro1220 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1221 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1208 withColumn srow_index ro1221 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1222 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ylo1223 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1223 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1223 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1224 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1215 join ro1222 ro1224 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1225 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1225 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1226 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1226 write e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1227 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1227 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1228 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1228 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1229 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1229 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1230 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1230 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yro1231 (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: c o1231 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1192 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1197 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1205 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1211 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1177 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1178 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1179 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1180 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1182 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1183 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1184 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1185 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1186 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1187 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1188 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1189 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1190 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1191 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1193 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1194 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1195 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1196 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1198 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1199 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1200 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1201 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1202 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1204 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1206 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1207 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1209 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1210 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1212 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1213 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1214 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1218 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Command to send: m d o1223 e (clientserver.py:501, send_command) 2025-04-02 03:03:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1232 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1232 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o55 range i3 i4 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1233 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ylo1234 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1234 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1234 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1235 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1233 toDF ro1235 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1236 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1237 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1237 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o55 range i4 i5 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1238 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ylo1239 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1239 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1239 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1240 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1238 toDF ro1240 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1241 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1241 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1242 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1243 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1243 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1244 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1244 get e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1245 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1246 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yao1247 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1246 applyModifiableSettings ro1245 ro1247 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1248 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1242 cast ro1248 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1249 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1241 withColumn sb ro1249 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1250 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1251 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1252 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ylo1253 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1253 add ro1252 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1253 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1254 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1254 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1255 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1251 over ro1255 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1256 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1236 withColumn srow_index ro1256 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1257 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1258 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1259 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ylo1260 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1260 add ro1259 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1260 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1261 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1261 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1262 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1258 over ro1262 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1263 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1250 withColumn srow_index ro1263 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1264 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ylo1265 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1265 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1265 e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1266 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1257 join ro1264 ro1266 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1267 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1267 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1268 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1268 write e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1269 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1269 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1270 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1270 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1271 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1271 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1272 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1272 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Answer received: !yro1273 (clientserver.py:512, send_command) 2025-04-02 03:03:53 [ 600 ] DEBUG : Command to send: c o1273 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1234 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1239 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1247 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1219 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1220 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1221 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1222 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1224 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1225 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1226 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1227 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1228 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1229 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1230 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1231 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1232 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1233 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1235 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1237 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1238 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1240 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1241 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1242 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1243 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1244 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1246 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1248 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1249 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1253 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1260 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Command to send: m d o1265 e (clientserver.py:501, send_command) 2025-04-02 03:03:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1274 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1274 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o55 range i4 i5 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1275 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ylo1276 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1276 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1276 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1277 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1275 toDF ro1277 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1278 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1279 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1279 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o55 range i5 i6 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1280 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ylo1281 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1281 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1281 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1282 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1280 toDF ro1282 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1283 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1283 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1284 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1285 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1285 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1286 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1286 get e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1287 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1288 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yao1289 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1288 applyModifiableSettings ro1287 ro1289 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1290 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1284 cast ro1290 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1291 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1283 withColumn sb ro1291 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1292 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1293 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1294 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ylo1295 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1295 add ro1294 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1295 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1296 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1296 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1297 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1293 over ro1297 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1298 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1278 withColumn srow_index ro1298 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1299 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1300 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1301 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ylo1302 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1302 add ro1301 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1302 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1303 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1303 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1304 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1300 over ro1304 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1305 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1292 withColumn srow_index ro1305 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1306 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ylo1307 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1307 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1307 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1308 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1299 join ro1306 ro1308 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1309 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1309 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1310 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1310 write e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1311 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1311 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1312 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1312 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1313 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1313 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1314 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1314 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yro1315 (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: c o1315 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1276 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1281 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1289 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1255 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1256 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1257 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1258 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1259 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1261 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1262 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1263 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1264 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1266 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1267 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1268 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1269 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1270 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1271 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1272 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1273 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1274 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1275 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1277 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1279 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1280 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1282 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1283 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1284 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1285 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1286 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1288 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1290 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1291 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1295 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1302 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Command to send: m d o1307 e (clientserver.py:501, send_command) 2025-04-02 03:03:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1316 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1316 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o55 range i5 i6 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1317 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ylo1318 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1318 add sa e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1318 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1319 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1317 toDF ro1319 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1320 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1321 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1321 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o55 range i6 i7 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1322 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ylo1323 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1323 add sb e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1323 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1324 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1322 toDF ro1324 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1325 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1325 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1326 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1327 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1327 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1328 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1328 get e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1329 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1330 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yao1331 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1330 applyModifiableSettings ro1329 ro1331 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1332 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1326 cast ro1332 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1333 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1325 withColumn sb ro1333 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1334 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1335 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1336 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ylo1337 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1337 add ro1336 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1337 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1338 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1338 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1339 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1335 over ro1339 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1340 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1320 withColumn srow_index ro1340 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1341 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1342 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1343 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ylo1344 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1344 add ro1343 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1344 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1345 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1345 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1346 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1342 over ro1346 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1347 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1334 withColumn srow_index ro1347 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1348 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ylo1349 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1349 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1349 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1350 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1341 join ro1348 ro1350 sinner e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1351 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1351 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1352 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1352 write e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1353 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1353 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1354 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1354 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1355 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1355 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1356 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1356 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yro1357 (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: c o1357 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1318 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1323 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1331 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1296 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1297 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1298 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1299 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1300 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1301 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1303 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1304 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1305 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1306 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1308 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1309 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1310 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1311 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1312 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1313 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1314 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1315 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1316 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1317 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1319 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1321 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1322 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1324 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1327 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1328 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1330 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1337 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1344 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Command to send: m d o1349 e (clientserver.py:501, send_command) 2025-04-02 03:03:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1358 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1358 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o55 range i6 i7 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1359 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ylo1360 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1360 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1360 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1361 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1359 toDF ro1361 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1362 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1363 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1363 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o55 range i7 i8 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1364 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ylo1365 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1365 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1365 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1366 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1364 toDF ro1366 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1367 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1367 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1368 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1369 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1369 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1370 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1370 get e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1371 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1372 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yao1373 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1372 applyModifiableSettings ro1371 ro1373 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1374 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1368 cast ro1374 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1375 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1367 withColumn sb ro1375 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1376 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1377 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1378 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ylo1379 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1379 add ro1378 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1379 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1380 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1380 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1381 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1377 over ro1381 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1382 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1362 withColumn srow_index ro1382 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1383 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1384 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1385 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ylo1386 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1386 add ro1385 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1386 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1387 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1387 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1388 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1384 over ro1388 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1389 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1376 withColumn srow_index ro1389 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1390 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ylo1391 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1391 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1391 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1392 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1383 join ro1390 ro1392 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1393 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1393 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1394 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1394 write e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1395 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1395 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1396 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1396 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1397 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1397 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1398 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1398 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yro1399 (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: c o1399 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1360 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1365 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1144 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1142 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1119 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1166 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1173 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1175 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1174 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1161 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1208 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1215 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1217 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1216 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1203 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1254 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1236 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1250 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1252 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1251 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1245 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1278 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1292 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1294 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1293 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1287 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1332 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1320 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1325 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1326 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1333 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1334 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1335 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1336 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1338 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1339 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1340 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1341 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1342 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1343 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1345 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1346 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1347 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1348 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1350 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1351 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1352 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1353 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1354 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1355 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1356 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1357 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1358 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1359 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1361 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1363 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1364 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1366 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1369 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1373 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1379 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1386 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Command to send: m d o1391 e (clientserver.py:501, send_command) 2025-04-02 03:04:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1400 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1400 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o55 range i7 i8 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1401 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ylo1402 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1402 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1402 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1403 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1401 toDF ro1403 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1404 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1405 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1405 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o55 range i8 i9 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1406 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ylo1407 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1407 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1407 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1408 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1406 toDF ro1408 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1409 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1409 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1410 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1411 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1411 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1412 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1412 get e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1413 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1414 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yao1415 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1414 applyModifiableSettings ro1413 ro1415 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1416 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1410 cast ro1416 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1417 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1409 withColumn sb ro1417 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1418 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1419 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1420 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ylo1421 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1421 add ro1420 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1421 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1422 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1422 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1423 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1419 over ro1423 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1424 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1404 withColumn srow_index ro1424 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1425 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1426 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1427 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ylo1428 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1428 add ro1427 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1428 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1429 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1429 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1430 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1426 over ro1430 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1431 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1418 withColumn srow_index ro1431 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1432 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ylo1433 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1433 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1433 e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1434 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1425 join ro1432 ro1434 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1435 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1435 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1436 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1436 write e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1437 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1437 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1438 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1438 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1439 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1439 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1440 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1440 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Answer received: !yro1441 (clientserver.py:512, send_command) 2025-04-02 03:04:04 [ 600 ] DEBUG : Command to send: c o1441 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1372 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1374 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1375 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1376 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1377 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1378 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1380 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1381 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1382 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1383 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1384 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1385 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1387 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1388 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1389 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1390 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1392 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1393 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1394 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1395 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1396 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1397 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1398 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1399 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1400 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1402 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1407 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1415 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1421 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1428 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1433 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1403 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1404 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1405 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1406 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1408 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1409 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1410 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1411 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1412 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1414 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1416 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1417 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1418 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1419 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1420 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1422 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1423 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1424 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1425 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1426 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1427 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1429 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1430 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1431 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1432 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1434 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1435 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1437 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1438 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1439 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Command to send: m d o1440 e (clientserver.py:501, send_command) 2025-04-02 03:04:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1442 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1442 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o55 range i8 i9 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1443 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ylo1444 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1444 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1444 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1445 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1443 toDF ro1445 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1446 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1447 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1447 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o55 range i9 i10 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1448 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ylo1449 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1449 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1449 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1450 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1448 toDF ro1450 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1451 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1451 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1452 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1453 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1453 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1454 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1454 get e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1455 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1456 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yao1457 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1456 applyModifiableSettings ro1455 ro1457 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1458 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1452 cast ro1458 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1459 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1451 withColumn sb ro1459 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1460 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1461 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1462 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ylo1463 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1463 add ro1462 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1463 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1464 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1464 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1465 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1461 over ro1465 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1466 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1446 withColumn srow_index ro1466 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1467 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1468 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1469 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ylo1470 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1470 add ro1469 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1470 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1471 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1471 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1472 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1468 over ro1472 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1473 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1460 withColumn srow_index ro1473 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1474 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ylo1475 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1475 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1475 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1476 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1467 join ro1474 ro1476 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1477 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1477 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1478 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1478 write e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1479 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1479 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1480 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1480 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1481 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1481 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1482 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1482 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yro1483 (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: c o1483 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1444 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1449 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1457 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1463 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1470 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1475 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1442 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1443 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1445 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1446 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1447 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1448 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1450 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1451 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1452 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1453 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1454 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1456 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1458 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1459 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1460 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1461 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1462 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1464 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1465 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1466 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1468 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1469 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1471 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1472 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1473 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Command to send: m d o1476 e (clientserver.py:501, send_command) 2025-04-02 03:04:07 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1484 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1484 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o55 range i9 i10 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1485 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ylo1486 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1486 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1486 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1487 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1485 toDF ro1487 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1488 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1489 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1489 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o55 range i10 i11 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1490 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ylo1491 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1491 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1491 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1492 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1490 toDF ro1492 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1493 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1493 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1494 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1495 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1495 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1496 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1496 get e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1497 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1498 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yao1499 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1498 applyModifiableSettings ro1497 ro1499 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1500 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1494 cast ro1500 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1501 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1493 withColumn sb ro1501 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1502 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1503 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1504 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ylo1505 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1505 add ro1504 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1505 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1506 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1506 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1507 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1503 over ro1507 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1508 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1488 withColumn srow_index ro1508 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1509 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1510 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1511 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ylo1512 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1512 add ro1511 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1512 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1513 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1513 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1514 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1510 over ro1514 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1515 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1502 withColumn srow_index ro1515 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1516 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ylo1517 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1517 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1517 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1518 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1509 join ro1516 ro1518 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1519 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1519 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1520 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1520 write e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1521 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1521 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1522 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1522 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1523 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1523 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1524 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1524 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yro1525 (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: c o1525 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1486 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1491 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1499 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1505 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1512 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1478 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1479 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1480 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1481 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1482 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1483 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1484 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1485 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1487 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1488 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1489 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1490 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1492 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1493 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1494 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1495 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1496 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1498 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1500 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1501 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1503 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1504 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1506 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1507 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1508 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1510 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1511 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1513 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1514 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Command to send: m d o1517 e (clientserver.py:501, send_command) 2025-04-02 03:04:10 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1526 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1526 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o55 range i10 i11 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1527 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ylo1528 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1528 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1528 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1529 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1527 toDF ro1529 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1530 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1531 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1531 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o55 range i11 i12 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1532 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ylo1533 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1533 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1533 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1534 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1532 toDF ro1534 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1535 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1535 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1536 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1537 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1537 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1538 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1538 get e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1539 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1540 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yao1541 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1540 applyModifiableSettings ro1539 ro1541 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1542 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1536 cast ro1542 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1543 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1535 withColumn sb ro1543 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1544 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1545 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1546 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ylo1547 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1547 add ro1546 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1547 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1548 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1548 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1549 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1545 over ro1549 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1550 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1530 withColumn srow_index ro1550 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1551 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1552 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1553 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ylo1554 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1554 add ro1553 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1554 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1555 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1555 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1556 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1552 over ro1556 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1557 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1544 withColumn srow_index ro1557 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1558 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ylo1559 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1559 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1559 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1560 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1551 join ro1558 ro1560 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1561 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1561 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1562 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1562 write e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1563 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1563 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1564 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1564 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1565 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1565 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1566 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1566 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yro1567 (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: c o1567 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1528 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1533 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1541 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1547 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1518 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1519 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1520 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1521 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1522 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1523 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1524 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1525 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1526 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1527 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1529 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1530 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1531 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1532 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1534 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1535 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1536 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1537 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1538 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1540 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1542 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1543 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1545 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1546 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1548 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1549 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1550 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1554 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Command to send: m d o1559 e (clientserver.py:501, send_command) 2025-04-02 03:04:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:16 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:16 [ 600 ] DEBUG : Answer received: !yro1568 (clientserver.py:512, send_command) 2025-04-02 03:04:16 [ 600 ] DEBUG : Command to send: c o1568 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:16 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:16 [ 600 ] DEBUG : Command to send: c o55 range i11 i12 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1569 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ylo1570 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1570 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1570 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1571 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1569 toDF ro1571 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1572 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1573 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1573 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o55 range i12 i13 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1574 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ylo1575 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1575 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1575 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1576 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1574 toDF ro1576 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1577 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1577 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1578 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1579 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1579 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1580 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1580 get e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1581 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1582 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yao1583 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1582 applyModifiableSettings ro1581 ro1583 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1584 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1578 cast ro1584 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1585 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1577 withColumn sb ro1585 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1586 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1587 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1588 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ylo1589 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1589 add ro1588 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1589 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1590 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1590 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1591 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1587 over ro1591 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1592 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1572 withColumn srow_index ro1592 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1593 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1594 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1595 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ylo1596 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1596 add ro1595 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1596 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1597 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1597 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1598 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1594 over ro1598 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1599 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1586 withColumn srow_index ro1599 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1600 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ylo1601 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1601 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1601 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1602 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1593 join ro1600 ro1602 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1603 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1603 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1604 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1604 write e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1605 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1605 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1606 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1606 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1607 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1607 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1608 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1608 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yro1609 (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: c o1609 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1570 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1575 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1583 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1589 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1555 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1556 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1557 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1558 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1560 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1561 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1562 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1563 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1564 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1565 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1566 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1567 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1568 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1569 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1571 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1572 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1573 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1574 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1576 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1577 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1578 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1579 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1580 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1582 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1584 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1585 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1587 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1588 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1590 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1591 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1592 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1596 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Command to send: m d o1601 e (clientserver.py:501, send_command) 2025-04-02 03:04:17 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1610 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1610 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o55 range i12 i13 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1611 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ylo1612 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1612 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1612 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1613 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1611 toDF ro1613 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1614 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1615 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1615 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o55 range i13 i14 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1616 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ylo1617 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1617 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1617 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1618 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1616 toDF ro1618 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1619 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1619 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1620 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1621 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1621 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1622 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1622 get e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1623 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1624 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yao1625 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1624 applyModifiableSettings ro1623 ro1625 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1626 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1620 cast ro1626 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1627 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1619 withColumn sb ro1627 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1628 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1629 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1630 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ylo1631 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1631 add ro1630 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1631 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1632 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1632 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1633 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1629 over ro1633 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1634 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1614 withColumn srow_index ro1634 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1635 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1636 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1637 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ylo1638 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1638 add ro1637 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1638 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1639 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1639 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1640 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1636 over ro1640 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1641 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1628 withColumn srow_index ro1641 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1642 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ylo1643 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1643 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1643 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1644 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1635 join ro1642 ro1644 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1645 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1645 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1646 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1646 write e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1647 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1647 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1648 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1648 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1649 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1649 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1650 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1650 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yro1651 (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: c o1651 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1612 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1617 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1625 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1594 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1595 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1597 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1598 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1599 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1600 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1602 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1603 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1604 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1605 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1606 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1607 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1608 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1609 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1610 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1611 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1613 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1615 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1616 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1618 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1619 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1620 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1621 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1622 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1624 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1626 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1627 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1631 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1638 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Command to send: m d o1643 e (clientserver.py:501, send_command) 2025-04-02 03:04:20 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1652 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1652 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o55 range i13 i14 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1653 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ylo1654 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1654 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1654 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1655 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1653 toDF ro1655 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1656 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1657 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1657 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o55 range i14 i15 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1658 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ylo1659 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1659 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1659 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1660 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1658 toDF ro1660 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1661 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1661 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1662 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1663 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1663 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1664 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1664 get e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1665 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1666 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yao1667 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1666 applyModifiableSettings ro1665 ro1667 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1668 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1662 cast ro1668 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1669 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1661 withColumn sb ro1669 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1670 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1671 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1672 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ylo1673 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1673 add ro1672 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1673 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1674 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1674 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1675 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1671 over ro1675 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1676 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1656 withColumn srow_index ro1676 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1677 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1678 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1679 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ylo1680 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1680 add ro1679 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1680 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1681 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1681 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1682 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1678 over ro1682 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1683 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1670 withColumn srow_index ro1683 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1684 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ylo1685 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1685 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1685 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1686 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1677 join ro1684 ro1686 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1687 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1687 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1688 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1688 write e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1689 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1689 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1690 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1690 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1691 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1691 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1692 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1692 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yro1693 (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: c o1693 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1654 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1659 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1667 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1632 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1633 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1634 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1635 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1636 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1637 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1639 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1640 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1641 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1642 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1644 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1645 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1646 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1647 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1648 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1649 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1650 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1651 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1652 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1653 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1655 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1657 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1658 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1660 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1661 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1662 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1663 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1664 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1666 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1668 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1669 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1673 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1680 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Command to send: m d o1685 e (clientserver.py:501, send_command) 2025-04-02 03:04:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1694 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1694 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o55 range i14 i15 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1695 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ylo1696 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1696 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1696 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1697 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1695 toDF ro1697 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1698 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1699 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1699 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o55 range i15 i16 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1700 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ylo1701 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1701 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1701 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1702 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1700 toDF ro1702 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1703 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1703 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1704 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1705 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1705 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1706 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1706 get e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1707 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1708 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yao1709 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1708 applyModifiableSettings ro1707 ro1709 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1710 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1704 cast ro1710 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1711 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1703 withColumn sb ro1711 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1712 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1713 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1714 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ylo1715 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1715 add ro1714 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1715 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1716 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1716 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1717 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1713 over ro1717 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1718 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1698 withColumn srow_index ro1718 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1719 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1720 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1721 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ylo1722 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1722 add ro1721 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1722 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1723 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1723 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1724 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1720 over ro1724 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1725 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1712 withColumn srow_index ro1725 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1726 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ylo1727 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1727 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1727 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1728 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1719 join ro1726 ro1728 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1729 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1729 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1730 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1730 write e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1731 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1731 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1732 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1732 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1733 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1733 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1734 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1734 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yro1735 (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: c o1735 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1696 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1701 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1671 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1672 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1674 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1675 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1676 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1677 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1678 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1679 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1681 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1682 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1683 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1684 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1686 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1687 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1688 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1689 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1690 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1691 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1692 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1693 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1694 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1695 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1697 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1699 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1700 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1702 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1705 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1709 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1715 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1722 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Command to send: m d o1727 e (clientserver.py:501, send_command) 2025-04-02 03:04:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1736 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1736 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o55 range i15 i16 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1737 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ylo1738 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1738 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1738 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1739 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1737 toDF ro1739 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1740 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1741 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1741 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o55 range i16 i17 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1742 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ylo1743 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1743 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1743 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1744 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1742 toDF ro1744 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1745 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1745 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1746 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1747 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1747 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1748 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1748 get e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1749 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1750 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yao1751 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1750 applyModifiableSettings ro1749 ro1751 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1752 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1746 cast ro1752 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1753 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1745 withColumn sb ro1753 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1754 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1755 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1756 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ylo1757 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1757 add ro1756 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1757 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1758 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1758 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1759 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1755 over ro1759 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1760 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1740 withColumn srow_index ro1760 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1761 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1762 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1763 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ylo1764 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1764 add ro1763 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1764 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1765 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1765 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1766 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1762 over ro1766 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1767 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1754 withColumn srow_index ro1767 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1768 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ylo1769 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1769 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1769 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1770 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1761 join ro1768 ro1770 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1771 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1771 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1772 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1772 write e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1773 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1773 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1774 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1774 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1775 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1775 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1776 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1776 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yro1777 (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: c o1777 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1738 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1743 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1708 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1710 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1711 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1712 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1713 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1714 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1716 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1717 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1718 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1719 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1720 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1721 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1723 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1724 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1725 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1726 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1728 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1729 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1730 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1731 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1732 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1733 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1734 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1735 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1736 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1737 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1739 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1741 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1742 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1744 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1751 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1757 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1764 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Command to send: m d o1769 e (clientserver.py:501, send_command) 2025-04-02 03:04:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1778 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1778 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o55 range i16 i17 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1779 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ylo1780 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1780 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1780 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1781 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1779 toDF ro1781 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1782 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1783 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1783 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o55 range i17 i18 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1784 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ylo1785 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1785 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1785 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1786 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1784 toDF ro1786 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1787 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1787 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1788 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1789 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1789 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1790 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1790 get e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1791 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1792 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yao1793 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1792 applyModifiableSettings ro1791 ro1793 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1794 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1788 cast ro1794 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1795 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1787 withColumn sb ro1795 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1796 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1797 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1798 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ylo1799 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1799 add ro1798 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1799 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1800 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1800 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1801 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1797 over ro1801 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1802 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1782 withColumn srow_index ro1802 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1803 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1804 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1805 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ylo1806 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1806 add ro1805 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1806 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1807 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1807 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1808 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1804 over ro1808 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1809 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1796 withColumn srow_index ro1809 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1810 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ylo1811 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1811 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1811 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1812 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1803 join ro1810 ro1812 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1813 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1813 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1814 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1814 write e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1815 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1815 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1816 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1816 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1817 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1817 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1818 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1818 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yro1819 (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: c o1819 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1780 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1747 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1748 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1750 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1752 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1753 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1754 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1755 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1756 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1758 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1759 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1760 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1761 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1762 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1763 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1765 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1766 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1767 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1768 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1770 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1771 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1772 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1773 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1774 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1775 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1776 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1777 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1778 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1779 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1781 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1785 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1793 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1799 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1806 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Command to send: m d o1811 e (clientserver.py:501, send_command) 2025-04-02 03:04:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1820 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1820 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o55 range i17 i18 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1821 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ylo1822 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1822 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1822 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1823 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1821 toDF ro1823 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1824 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1825 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1825 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o55 range i18 i19 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1826 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ylo1827 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1827 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1827 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1828 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1826 toDF ro1828 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1829 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1829 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1830 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1831 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1831 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1832 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1832 get e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1833 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1834 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yao1835 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1834 applyModifiableSettings ro1833 ro1835 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1836 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1830 cast ro1836 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1837 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1829 withColumn sb ro1837 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1838 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1839 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1840 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ylo1841 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1841 add ro1840 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1841 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1842 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1842 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1843 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1839 over ro1843 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1844 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1824 withColumn srow_index ro1844 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1845 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1846 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1847 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ylo1848 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1848 add ro1847 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1848 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1849 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1849 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1850 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1846 over ro1850 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1851 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1838 withColumn srow_index ro1851 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1852 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ylo1853 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1853 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1853 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1854 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1845 join ro1852 ro1854 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1855 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1855 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1856 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1856 write e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1857 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1857 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1858 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1858 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1859 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1859 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1860 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1860 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yro1861 (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: c o1861 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1401 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1371 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1441 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1436 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1413 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1467 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1474 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1477 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1455 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1515 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1516 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1502 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1509 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1497 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1544 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1551 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1553 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1552 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1539 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1586 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1593 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1581 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Command to send: m d o1614 e (clientserver.py:501, send_command) 2025-04-02 03:04:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1628 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1630 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1629 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1623 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1656 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1670 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1665 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1707 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1698 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1703 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1704 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1706 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1746 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1740 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1745 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1782 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1783 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1749 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1784 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1786 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1787 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1788 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1789 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1790 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1792 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1794 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1795 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1796 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1797 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1798 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1800 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1801 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1802 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1803 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1804 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1805 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1807 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1808 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1809 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1810 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1812 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1813 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1814 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1815 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1816 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1817 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1818 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1819 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1820 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1822 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1827 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1835 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1841 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1848 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1853 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o17 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o16 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o25 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o42 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o43 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o14 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o26 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o480 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o482 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o447 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o921 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o928 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o909 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1077 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1329 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1370 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1362 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1367 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1368 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1821 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1791 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1823 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1824 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1825 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1826 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1828 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1829 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1830 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1831 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1832 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1834 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1836 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1837 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1838 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1839 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1840 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1842 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1843 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1844 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1845 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1846 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1847 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1849 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1850 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1851 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1852 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1854 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1855 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1857 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1858 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1859 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Command to send: m d o1860 e (clientserver.py:501, send_command) 2025-04-02 03:04:35 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1862 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1862 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o55 range i18 i19 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1863 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ylo1864 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1864 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1864 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1865 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1863 toDF ro1865 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1866 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1867 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1867 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o55 range i19 i20 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1868 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ylo1869 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1869 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1869 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1870 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1868 toDF ro1870 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1871 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1871 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1872 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1873 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1873 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1874 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1874 get e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1875 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1876 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yao1877 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1876 applyModifiableSettings ro1875 ro1877 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1878 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1872 cast ro1878 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1879 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1871 withColumn sb ro1879 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1880 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1881 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1882 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ylo1883 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1883 add ro1882 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1883 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1884 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1884 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1885 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1881 over ro1885 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1886 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1866 withColumn srow_index ro1886 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1887 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1888 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1889 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ylo1890 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1890 add ro1889 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1890 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1891 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1891 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1892 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1888 over ro1892 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1893 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1880 withColumn srow_index ro1893 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1894 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ylo1895 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1895 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1895 e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1896 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1887 join ro1894 ro1896 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1897 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1897 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1898 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1898 write e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1899 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1899 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1900 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1900 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1901 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1901 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1902 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1902 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Answer received: !yro1903 (clientserver.py:512, send_command) 2025-04-02 03:04:38 [ 600 ] DEBUG : Command to send: c o1903 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Command to send: m d o1864 e (clientserver.py:501, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Command to send: m d o1869 e (clientserver.py:501, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Command to send: m d o1862 e (clientserver.py:501, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Command to send: m d o1863 e (clientserver.py:501, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Command to send: m d o1865 e (clientserver.py:501, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Command to send: m d o1867 e (clientserver.py:501, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Command to send: m d o1868 e (clientserver.py:501, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Command to send: m d o1870 e (clientserver.py:501, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Command to send: m d o1873 e (clientserver.py:501, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Command to send: m d o1874 e (clientserver.py:501, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Command to send: m d o1877 e (clientserver.py:501, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Command to send: m d o1883 e (clientserver.py:501, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Command to send: m d o1890 e (clientserver.py:501, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Command to send: m d o1895 e (clientserver.py:501, send_command) 2025-04-02 03:04:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1904 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1904 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o55 range i19 i20 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1905 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ylo1906 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1906 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1906 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1907 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1905 toDF ro1907 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1908 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1909 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1909 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o55 range i20 i21 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1910 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ylo1911 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1911 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1911 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1912 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1910 toDF ro1912 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1913 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1913 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1914 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1915 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1915 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1916 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1916 get e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1917 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1918 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yao1919 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1918 applyModifiableSettings ro1917 ro1919 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1920 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1914 cast ro1920 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1921 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1913 withColumn sb ro1921 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1922 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1923 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1924 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ylo1925 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1925 add ro1924 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1925 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1926 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1926 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1927 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1923 over ro1927 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1928 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1908 withColumn srow_index ro1928 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1929 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1930 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1931 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ylo1932 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1932 add ro1931 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1932 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1933 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1933 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1934 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1930 over ro1934 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1935 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1922 withColumn srow_index ro1935 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1936 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ylo1937 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1937 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1937 e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1938 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1929 join ro1936 ro1938 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1939 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1939 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1940 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1940 write e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1941 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1941 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1942 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1942 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1943 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1943 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1944 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1944 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Answer received: !yro1945 (clientserver.py:512, send_command) 2025-04-02 03:04:41 [ 600 ] DEBUG : Command to send: c o1945 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1906 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1911 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1878 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1879 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1880 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1881 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1882 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1884 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1885 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1886 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1887 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1888 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1889 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1891 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1892 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1893 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1894 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1896 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1897 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1898 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1899 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1900 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1901 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1902 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1903 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1904 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1905 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1907 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1909 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1910 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1912 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1915 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1919 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1925 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1932 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Command to send: m d o1937 e (clientserver.py:501, send_command) 2025-04-02 03:04:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1946 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1946 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o55 range i20 i21 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1947 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ylo1948 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1948 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1948 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1949 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1947 toDF ro1949 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1950 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1951 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1951 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o55 range i21 i22 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1952 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ylo1953 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1953 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1953 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1954 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1952 toDF ro1954 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1955 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1955 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1956 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1957 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1957 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1958 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1958 get e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1959 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1960 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yao1961 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1960 applyModifiableSettings ro1959 ro1961 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1948 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1962 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1956 cast ro1962 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1953 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1963 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1955 withColumn sb ro1963 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1918 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1920 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1921 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1922 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1923 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1964 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1924 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1926 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1927 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1928 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1929 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1930 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1965 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1931 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1933 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1934 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1935 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1936 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1938 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1939 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1966 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1940 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1941 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1942 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1943 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1944 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1945 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1946 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1947 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1949 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1951 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: m d o1961 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ylo1967 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1967 add ro1966 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1967 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1968 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1968 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1969 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1965 over ro1969 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1970 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1950 withColumn srow_index ro1970 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1971 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1972 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1973 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ylo1974 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1974 add ro1973 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1974 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1975 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro1975 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1976 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1972 over ro1976 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1977 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1964 withColumn srow_index ro1977 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1978 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ylo1979 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1979 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1979 e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1980 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1971 join ro1978 ro1980 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1981 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1981 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1982 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1982 write e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1983 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1983 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1984 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1984 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1985 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1985 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1986 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1986 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Answer received: !yro1987 (clientserver.py:512, send_command) 2025-04-02 03:04:44 [ 600 ] DEBUG : Command to send: c o1987 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:45 [ 600 ] DEBUG : Command to send: m d o1967 e (clientserver.py:501, send_command) 2025-04-02 03:04:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:45 [ 600 ] DEBUG : Command to send: m d o1974 e (clientserver.py:501, send_command) 2025-04-02 03:04:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:45 [ 600 ] DEBUG : Command to send: m d o1979 e (clientserver.py:501, send_command) 2025-04-02 03:04:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro1988 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o1988 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o55 range i21 i22 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro1989 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ylo1990 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o1990 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1990 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro1991 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o1989 toDF ro1991 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro1992 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro1993 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o1993 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o55 range i22 i23 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro1994 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ylo1995 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o1995 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro1995 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro1996 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o1994 toDF ro1996 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro1997 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o1997 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro1998 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro1999 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o1999 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2000 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o2000 get e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2001 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2002 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yao2003 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o2002 applyModifiableSettings ro2001 ro2003 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2004 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o1998 cast ro2004 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2005 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o1997 withColumn sb ro2005 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2006 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2007 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2008 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ylo2009 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o2009 add ro2008 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2009 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2010 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro2010 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2011 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o2007 over ro2011 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2012 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o1992 withColumn srow_index ro2012 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2013 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2014 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2015 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ylo2016 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o2016 add ro2015 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2016 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2017 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro2017 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2018 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o2014 over ro2018 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2019 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o2006 withColumn srow_index ro2019 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2020 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ylo2021 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o2021 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2021 e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2022 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o2013 join ro2020 ro2022 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2023 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o2023 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2024 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o2024 write e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2025 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o2025 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2026 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o2026 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2027 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o2027 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2028 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o2028 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Answer received: !yro2029 (clientserver.py:512, send_command) 2025-04-02 03:04:47 [ 600 ] DEBUG : Command to send: c o2029 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1990 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1956 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1957 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1958 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1960 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1962 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1963 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1964 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1965 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1966 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1968 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1969 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1970 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1971 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1972 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1973 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1975 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1976 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1977 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1978 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1980 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1981 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1982 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1983 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1984 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1985 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1986 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1987 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1988 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1989 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1991 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o1995 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o2003 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o2009 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o2016 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Command to send: m d o2021 e (clientserver.py:501, send_command) 2025-04-02 03:04:48 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2030 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2030 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o55 range i22 i23 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2031 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ylo2032 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2032 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2032 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2033 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2031 toDF ro2033 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2034 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2035 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2035 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o55 range i23 i24 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2036 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ylo2037 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2037 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2037 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2038 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2036 toDF ro2038 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2039 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2039 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2040 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2041 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2041 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2042 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2042 get e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2043 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2044 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yao2045 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2044 applyModifiableSettings ro2043 ro2045 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2046 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2040 cast ro2046 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2047 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2039 withColumn sb ro2047 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2048 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2049 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2050 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ylo2051 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2051 add ro2050 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2051 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2052 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro2052 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2053 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2049 over ro2053 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2054 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2034 withColumn srow_index ro2054 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2055 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2056 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2057 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ylo2058 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2058 add ro2057 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2058 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2059 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro2059 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2060 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2056 over ro2060 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2061 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2048 withColumn srow_index ro2061 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2062 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ylo2063 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2063 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2063 e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2064 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2055 join ro2062 ro2064 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2065 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2065 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2066 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2066 write e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2067 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2067 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2068 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2068 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2069 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2069 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2070 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2070 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Answer received: !yro2071 (clientserver.py:512, send_command) 2025-04-02 03:04:50 [ 600 ] DEBUG : Command to send: c o2071 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o1994 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o1996 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o1997 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o1998 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o1999 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2000 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2002 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2004 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2005 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2006 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2007 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2008 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2010 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2011 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2012 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2013 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2014 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2015 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2017 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2018 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2019 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2020 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2022 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2023 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2024 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2025 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2026 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2027 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2028 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2029 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2032 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2037 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2045 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2051 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2058 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2063 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2031 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2033 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2034 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2035 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2036 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2038 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2039 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2040 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2041 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2042 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2044 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2046 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2047 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2048 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2049 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2050 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2052 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2053 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2054 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2055 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2056 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2057 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2059 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2060 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2061 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2062 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2064 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2065 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2067 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2068 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2069 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Command to send: m d o2070 e (clientserver.py:501, send_command) 2025-04-02 03:04:51 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2072 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2072 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o55 range i23 i24 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2073 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ylo2074 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2074 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2074 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2075 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2073 toDF ro2075 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2076 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2077 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2077 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o55 range i24 i25 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2078 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ylo2079 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2079 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2079 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2080 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2078 toDF ro2080 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2081 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2081 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2082 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2083 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2083 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2084 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2084 get e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2085 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2086 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yao2087 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2086 applyModifiableSettings ro2085 ro2087 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2088 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2082 cast ro2088 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2089 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2081 withColumn sb ro2089 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2090 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2091 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2092 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ylo2093 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2093 add ro2092 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2093 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2094 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro2094 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2095 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2091 over ro2095 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2096 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2076 withColumn srow_index ro2096 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2097 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2098 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2099 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ylo2100 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2100 add ro2099 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2100 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2101 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro2101 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2102 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2098 over ro2102 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2103 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2090 withColumn srow_index ro2103 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2104 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ylo2105 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2105 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2105 e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2106 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2097 join ro2104 ro2106 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2107 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2107 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2108 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2108 write e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2109 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2109 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2110 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2110 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2111 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2111 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2112 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2112 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Answer received: !yro2113 (clientserver.py:512, send_command) 2025-04-02 03:04:53 [ 600 ] DEBUG : Command to send: c o2113 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2074 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2079 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2087 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2093 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2100 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2072 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2073 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2075 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2076 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2077 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2078 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2080 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2081 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2082 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2083 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2084 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2086 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2088 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2089 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2090 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2091 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2092 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2094 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2095 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2096 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2098 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2099 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2101 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2102 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2103 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Command to send: m d o2105 e (clientserver.py:501, send_command) 2025-04-02 03:04:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2114 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2114 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o55 range i24 i25 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2115 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ylo2116 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2116 add sa e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2116 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2117 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2115 toDF ro2117 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2118 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2119 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2119 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o55 range i25 i26 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2120 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ylo2121 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2121 add sb e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2121 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2122 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2120 toDF ro2122 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2123 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2123 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2124 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2125 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2125 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2126 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2126 get e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2127 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2128 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yao2129 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2128 applyModifiableSettings ro2127 ro2129 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2130 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2124 cast ro2130 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2131 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2123 withColumn sb ro2131 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2132 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2133 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2134 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ylo2135 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2135 add ro2134 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2135 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2136 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro2136 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2137 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2133 over ro2137 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2138 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2118 withColumn srow_index ro2138 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2139 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2140 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2141 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ylo2142 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2142 add ro2141 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2142 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2143 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro2143 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2144 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2140 over ro2144 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2145 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2132 withColumn srow_index ro2145 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2146 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ylo2147 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2147 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2147 e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2148 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2139 join ro2146 ro2148 sinner e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2149 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2149 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2150 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2150 write e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2151 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2151 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2152 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2152 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2153 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2153 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2154 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2154 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Answer received: !yro2155 (clientserver.py:512, send_command) 2025-04-02 03:04:56 [ 600 ] DEBUG : Command to send: c o2155 save s/test_checkpointZ068HGYnLH e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2116 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2121 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2129 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2135 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2106 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2107 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2108 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2109 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2110 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2111 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2112 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2113 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2114 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2115 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2117 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2118 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2119 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2120 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2122 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2123 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2124 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2125 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2126 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2128 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2130 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2131 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2133 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2134 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2136 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2137 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2138 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2142 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Command to send: m d o2147 e (clientserver.py:501, send_command) 2025-04-02 03:04:57 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:04:59 [ 600 ] DEBUG : Resetting dropped connection: 172.16.1.8 (connectionpool.py:293, _get_conn) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-ed7d2c27-7efd-4960-89a5-94e01aee260c-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-b3c24db0-2c56-4b38-a34f-3c31d6e8202b-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-2e867236-49fe-4b1f-a39d-fa8ca0e28118-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-f7ddfc18-57d4-46d2-911e-260b80023162-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-85d2cf67-17db-4dfa-b3b0-cb8bf9ba304f-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-ae8412e8-500f-4ba4-8d8d-03c73f931518-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-217434d1-5a6e-4491-a7ab-f06b678c5aab-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000016.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000007.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000003.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000010.checkpoint.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000008.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000021.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000001.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000020.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000013.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000004.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000020.checkpoint.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000002.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000014.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000017.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000022.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000012.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000005.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000015.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000024.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000006.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000009.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/_last_checkpoint HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000011.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000023.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000010.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000018.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/_delta_log/00000000000000000019.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-f01b9f96-f0b9-49c6-ac0e-49f47717533f-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-3fb16190-ad7c-4a9c-85bf-61d812a3e8cf-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-fad874c7-408a-4d52-ade0-100875b6c105-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-5c13cf97-689a-426c-a191-f2eaa3b92bcd-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-64fd4e38-03ce-46aa-82a8-e726e825935d-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-fab19d1e-7500-45f2-a9cd-8b3e4d4838f7-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-074fd5e8-d6f8-4297-b0f8-4b3f4b254474-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-d862e053-f17c-46c4-b933-3a0110fad605-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-be1f4dd9-a9a2-478d-81d1-6c632a7fad75-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-c453fe37-b7aa-4d84-9e09-d3c7c1cd96d8-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-d0b8aef8-3a5e-440e-8c10-c3c81438a2cf-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-5381ada5-d51e-419c-a341-bb2cad152a87-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-20f485e8-c9f6-4b7f-9870-d12eacf5a2ff-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-43e7065b-f5d3-42f3-9680-597161a05e00-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-af4a0f82-b666-4abc-bec2-d97b61c87774-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-7365ab78-ca8d-45ae-91fd-8dfcd4f7765b-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-7b018ce9-865f-42d8-8077-fa9321732477-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_checkpointZ068HGYnLH/part-00000-72e204cb-eac1-4590-8c50-85830ca6cdc2-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:04:59 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_checkpointZ068HGYnLH; CREATE TABLE test_checkpointZ068HGYnLH ENGINE=DeltaLake(s3, filename = 'test_checkpointZ068HGYnLH/', url = 'http://minio1:9001/root/') SETTINGS allow_experimental_delta_kernel_rs=1 on node1 (cluster.py:3564, query) ____________________________ test_complex_types[0] _____________________________ started_cluster = use_delta_kernel = '0' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_complex_types(started_cluster, use_delta_kernel): node = started_cluster.instances["node1"] minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket schema = pa.schema( [ pa.field("id", pa.int32(), nullable=False), pa.field("name", pa.string(), nullable=False), ( "address", pa.struct( [ ("street", pa.string()), ("city", pa.string()), ("state", pa.string()), ] ), ), ("interests", pa.list_(pa.string())), ( "metadata", pa.map_( pa.string(), pa.string() ), # Map with string keys and string values ), ] ) # Create sample data data = [ pa.array([1, 2, 3], type=pa.int32()), pa.array(["John Doe", "Jane Smith", "Jake Johnson"], type=pa.string()), pa.array( [ {"street": "123 Elm St", "city": "Springfield", "state": "IL"}, {"street": "456 Maple St", "city": "Shelbyville", "state": "IL"}, {"street": "789 Oak St", "city": "Ogdenville", "state": "IL"}, ], type=schema.field("address").type, ), pa.array( [ pa.array(["dancing", "coding", "hiking"]), pa.array(["dancing", "coding", "hiking"]), pa.array(["dancing", "coding", "hiking"]), ], type=schema.field("interests").type, ), pa.array( [ {"key1": "value1", "key2": "value2"}, {"key1": "value3", "key2": "value4"}, {"key1": "value5", "key2": "value6"}, ], type=schema.field("metadata").type, ), ] endpoint_url = f"http://{started_cluster.minio_ip}:{started_cluster.minio_port}" aws_access_key_id = "minio" aws_secret_access_key = "minio123" table_name = randomize_table_name("test_complex_types") storage_options = { "AWS_ENDPOINT_URL": endpoint_url, "AWS_ACCESS_KEY_ID": aws_access_key_id, "AWS_SECRET_ACCESS_KEY": aws_secret_access_key, "AWS_ALLOW_HTTP": "true", "AWS_S3_ALLOW_UNSAFE_RENAME": "true", } path = f"s3://root/{table_name}" table = pa.Table.from_arrays(data, schema=schema) write_deltalake(path, table, storage_options=storage_options) > assert "1\n2\n3\n" in node.query( f"SELECT id FROM deltaLake('http://{started_cluster.minio_ip}:{started_cluster.minio_port}/root/{table_name}' , 'minio', 'minio123', SETTINGS allow_experimental_delta_kernel_rs={use_delta_kernel})" ) test_storage_delta/test.py:851: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 46, stderr: Received exception from server (version 25.2.2): E Code: 46. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table function deltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:4733: DB::QueryAnalyzer::resolveTableFunction(std::shared_ptr&, DB::IdentifierResolveScope&, DB::QueryExpressionsAliasVisitor&, bool) @ 0x0000000027c11c4d E 5. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:5317: DB::QueryAnalyzer::resolveQueryJoinTreeNode(std::shared_ptr&, DB::IdentifierResolveScope&, DB::QueryExpressionsAliasVisitor&) @ 0x0000000027c5db2e E 6. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:5570: DB::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::IdentifierResolveScope&) @ 0x0000000027bfc2ab E 7. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:176: DB::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x0000000027bfa4c8 E 8. ./build_docker/./src/Analyzer/Resolve/QueryAnalysisPass.cpp:18: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x0000000027bf8f77 E 9. ./build_docker/./src/Analyzer/QueryTreePassManager.cpp:184: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x0000000027cc7c4c E 10. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:151: DB::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x0000000029833a52 E 11. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:168: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000002982f7d6 E 12. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: std::__unique_if::__unique_single std::make_unique[abi:ne190107]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x0000000029836fde E 13. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002974e7db E 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1391: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a019ba0 E 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 16. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 17. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 19. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 21. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 22. asan_thread_start(void*) @ 0x000000000b6a3e77 E 23. ? @ 0x00007fa1c9941ac3 E 24. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_FUNCTION) E (query: SELECT id FROM deltaLake('http://172.16.1.8:9001/root/test_complex_typesdsDQRk4BcJ' , 'minio', 'minio123', SETTINGS allow_experimental_delta_kernel_rs=0)) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2143 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2144 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2145 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2146 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2148 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2149 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2150 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2151 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2152 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2153 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2154 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2155 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1875 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1866 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1871 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1872 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1876 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1917 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1908 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1913 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Executing query SELECT id FROM deltaLake('http://172.16.1.8:9001/root/test_complex_typesdsDQRk4BcJ' , 'minio', 'minio123', SETTINGS allow_experimental_delta_kernel_rs=0) on node1 (cluster.py:3564, query) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1914 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1916 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1954 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1955 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1950 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1952 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1993 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1992 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o1959 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2030 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2001 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2071 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2066 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2043 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2097 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2104 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2085 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2132 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2139 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2141 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Command to send: m d o2140 e (clientserver.py:501, send_command) 2025-04-02 03:05:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) ____________________________ test_complex_types[1] _____________________________ started_cluster = use_delta_kernel = '1' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_complex_types(started_cluster, use_delta_kernel): node = started_cluster.instances["node1"] minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket schema = pa.schema( [ pa.field("id", pa.int32(), nullable=False), pa.field("name", pa.string(), nullable=False), ( "address", pa.struct( [ ("street", pa.string()), ("city", pa.string()), ("state", pa.string()), ] ), ), ("interests", pa.list_(pa.string())), ( "metadata", pa.map_( pa.string(), pa.string() ), # Map with string keys and string values ), ] ) # Create sample data data = [ pa.array([1, 2, 3], type=pa.int32()), pa.array(["John Doe", "Jane Smith", "Jake Johnson"], type=pa.string()), pa.array( [ {"street": "123 Elm St", "city": "Springfield", "state": "IL"}, {"street": "456 Maple St", "city": "Shelbyville", "state": "IL"}, {"street": "789 Oak St", "city": "Ogdenville", "state": "IL"}, ], type=schema.field("address").type, ), pa.array( [ pa.array(["dancing", "coding", "hiking"]), pa.array(["dancing", "coding", "hiking"]), pa.array(["dancing", "coding", "hiking"]), ], type=schema.field("interests").type, ), pa.array( [ {"key1": "value1", "key2": "value2"}, {"key1": "value3", "key2": "value4"}, {"key1": "value5", "key2": "value6"}, ], type=schema.field("metadata").type, ), ] endpoint_url = f"http://{started_cluster.minio_ip}:{started_cluster.minio_port}" aws_access_key_id = "minio" aws_secret_access_key = "minio123" table_name = randomize_table_name("test_complex_types") storage_options = { "AWS_ENDPOINT_URL": endpoint_url, "AWS_ACCESS_KEY_ID": aws_access_key_id, "AWS_SECRET_ACCESS_KEY": aws_secret_access_key, "AWS_ALLOW_HTTP": "true", "AWS_S3_ALLOW_UNSAFE_RENAME": "true", } path = f"s3://root/{table_name}" table = pa.Table.from_arrays(data, schema=schema) write_deltalake(path, table, storage_options=storage_options) > assert "1\n2\n3\n" in node.query( f"SELECT id FROM deltaLake('http://{started_cluster.minio_ip}:{started_cluster.minio_port}/root/{table_name}' , 'minio', 'minio123', SETTINGS allow_experimental_delta_kernel_rs={use_delta_kernel})" ) test_storage_delta/test.py:851: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 46, stderr: Received exception from server (version 25.2.2): E Code: 46. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table function deltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:4733: DB::QueryAnalyzer::resolveTableFunction(std::shared_ptr&, DB::IdentifierResolveScope&, DB::QueryExpressionsAliasVisitor&, bool) @ 0x0000000027c11c4d E 5. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:5317: DB::QueryAnalyzer::resolveQueryJoinTreeNode(std::shared_ptr&, DB::IdentifierResolveScope&, DB::QueryExpressionsAliasVisitor&) @ 0x0000000027c5db2e E 6. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:5570: DB::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::IdentifierResolveScope&) @ 0x0000000027bfc2ab E 7. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:176: DB::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x0000000027bfa4c8 E 8. ./build_docker/./src/Analyzer/Resolve/QueryAnalysisPass.cpp:18: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x0000000027bf8f77 E 9. ./build_docker/./src/Analyzer/QueryTreePassManager.cpp:184: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x0000000027cc7c4c E 10. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:151: DB::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x0000000029833a52 E 11. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:168: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x000000002982f7d6 E 12. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: std::__unique_if::__unique_single std::make_unique[abi:ne190107]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x0000000029836fde E 13. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002974e7db E 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1391: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a019ba0 E 15. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 16. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 17. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 18. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 19. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 20. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 21. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 22. asan_thread_start(void*) @ 0x000000000b6a3e77 E 23. ? @ 0x00007fa1c9941ac3 E 24. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_FUNCTION) E (query: SELECT id FROM deltaLake('http://172.16.1.8:9001/root/test_complex_types2C1WF7Nzn7' , 'minio', 'minio123', SETTINGS allow_experimental_delta_kernel_rs=1)) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:05:00 [ 600 ] DEBUG : Executing query SELECT id FROM deltaLake('http://172.16.1.8:9001/root/test_complex_types2C1WF7Nzn7' , 'minio', 'minio123', SETTINGS allow_experimental_delta_kernel_rs=1) on node1 (cluster.py:3564, query) _________________________ test_filesystem_cache[0-s3] __________________________ started_cluster = storage_type = 's3', use_delta_kernel = '0' @pytest.mark.parametrize("storage_type", ["s3"]) @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_filesystem_cache(started_cluster, storage_type, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client TABLE_NAME = randomize_table_name("test_filesystem_cache") bucket = started_cluster.minio_bucket if not minio_client.bucket_exists(bucket): minio_client.make_bucket(bucket) parquet_data_path = create_initial_data_file( started_cluster, instance, "SELECT toUInt64(number), toString(number) FROM numbers(100)", TABLE_NAME, ) write_delta_from_file(spark, parquet_data_path, f"/{TABLE_NAME}") upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") > create_delta_table(instance, TABLE_NAME, bucket=bucket, use_delta_kernel=use_delta_kernel) test_storage_delta/test.py:889: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_delta/test.py:152: in create_delta_table node.query( helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 56, stderr: Received exception from server (version 25.2.2): E Code: 56. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table engine DeltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Storages/StorageFactory.cpp:276: DB::StorageFactory::getStorageFeatures(String const&) const @ 0x000000002d62e3cc E 5. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:105: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr const&, std::shared_ptr) @ 0x000000002995251c E 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1124: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a015adc E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 8. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 9. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 11. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 13. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 14. asan_thread_start(void*) @ 0x000000000b6a3e77 E 15. ? @ 0x00007fa1c9941ac3 E 16. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_STORAGE) E (query: CREATE TABLE test_filesystem_cacheJbBAwMMoBd E ENGINE=DeltaLake(s3, filename = 'test_filesystem_cacheJbBAwMMoBd/', url = 'http://minio1:9001/root/') E SETTINGS allow_experimental_delta_kernel_rs=0) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:05:01 [ 600 ] DEBUG : http://172.16.1.8:9001 "HEAD /root HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:01 [ 600 ] DEBUG : Executing query INSERT INTO TABLE FUNCTION file('test_filesystem_cacheJbBAwMMoBd.parquet') SETTINGS output_format_parquet_compression_method='none', s3_truncate_on_insert=1 SELECT toUInt64(number), toString(number) FROM numbers(100) FORMAT Parquet on node1 (cluster.py:3564, query) 2025-04-02 03:05:01 [ 600 ] DEBUG : Command to send: c o55 read e (clientserver.py:501, send_command) 2025-04-02 03:05:01 [ 600 ] DEBUG : Answer received: !yro2156 (clientserver.py:512, send_command) 2025-04-02 03:05:01 [ 600 ] DEBUG : Command to send: c o2156 load s/ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/database/user_files/test_filesystem_cacheJbBAwMMoBd.parquet e (clientserver.py:501, send_command) 2025-04-02 03:05:01 [ 600 ] DEBUG : Answer received: !yro2157 (clientserver.py:512, send_command) 2025-04-02 03:05:01 [ 600 ] DEBUG : Command to send: c o2157 write e (clientserver.py:501, send_command) 2025-04-02 03:05:01 [ 600 ] DEBUG : Answer received: !yro2158 (clientserver.py:512, send_command) 2025-04-02 03:05:01 [ 600 ] DEBUG : Command to send: c o2158 mode soverwrite e (clientserver.py:501, send_command) 2025-04-02 03:05:01 [ 600 ] DEBUG : Answer received: !yro2159 (clientserver.py:512, send_command) 2025-04-02 03:05:01 [ 600 ] DEBUG : Command to send: c o2159 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:05:01 [ 600 ] DEBUG : Answer received: !yro2160 (clientserver.py:512, send_command) 2025-04-02 03:05:01 [ 600 ] DEBUG : Command to send: c o2160 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:01 [ 600 ] DEBUG : Answer received: !yro2161 (clientserver.py:512, send_command) 2025-04-02 03:05:01 [ 600 ] DEBUG : Command to send: c o2161 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:05:01 [ 600 ] DEBUG : Answer received: !yro2162 (clientserver.py:512, send_command) 2025-04-02 03:05:01 [ 600 ] DEBUG : Command to send: c o2162 save s/test_filesystem_cacheJbBAwMMoBd e (clientserver.py:501, send_command) 2025-04-02 03:05:04 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:04 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_filesystem_cacheJbBAwMMoBd/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:04 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_filesystem_cacheJbBAwMMoBd/part-00000-c7b1efc0-bbb5-499b-9559-60656b21d019-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:04 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_filesystem_cacheJbBAwMMoBd; CREATE TABLE test_filesystem_cacheJbBAwMMoBd ENGINE=DeltaLake(s3, filename = 'test_filesystem_cacheJbBAwMMoBd/', url = 'http://minio1:9001/root/') SETTINGS allow_experimental_delta_kernel_rs=0 on node1 (cluster.py:3564, query) _________________________ test_filesystem_cache[1-s3] __________________________ started_cluster = storage_type = 's3', use_delta_kernel = '1' @pytest.mark.parametrize("storage_type", ["s3"]) @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_filesystem_cache(started_cluster, storage_type, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client TABLE_NAME = randomize_table_name("test_filesystem_cache") bucket = started_cluster.minio_bucket if not minio_client.bucket_exists(bucket): minio_client.make_bucket(bucket) parquet_data_path = create_initial_data_file( started_cluster, instance, "SELECT toUInt64(number), toString(number) FROM numbers(100)", TABLE_NAME, ) write_delta_from_file(spark, parquet_data_path, f"/{TABLE_NAME}") upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") > create_delta_table(instance, TABLE_NAME, bucket=bucket, use_delta_kernel=use_delta_kernel) test_storage_delta/test.py:889: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_delta/test.py:152: in create_delta_table node.query( helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 56, stderr: Received exception from server (version 25.2.2): E Code: 56. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table engine DeltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Storages/StorageFactory.cpp:276: DB::StorageFactory::getStorageFeatures(String const&) const @ 0x000000002d62e3cc E 5. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:105: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr const&, std::shared_ptr) @ 0x000000002995251c E 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1124: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a015adc E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 8. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 9. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 11. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 13. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 14. asan_thread_start(void*) @ 0x000000000b6a3e77 E 15. ? @ 0x00007fa1c9941ac3 E 16. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_STORAGE) E (query: CREATE TABLE test_filesystem_cache3xGH1RNBfl E ENGINE=DeltaLake(s3, filename = 'test_filesystem_cache3xGH1RNBfl/', url = 'http://minio1:9001/root/') E SETTINGS allow_experimental_delta_kernel_rs=1) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:05:05 [ 600 ] DEBUG : http://172.16.1.8:9001 "HEAD /root HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:05 [ 600 ] DEBUG : Executing query INSERT INTO TABLE FUNCTION file('test_filesystem_cache3xGH1RNBfl.parquet') SETTINGS output_format_parquet_compression_method='none', s3_truncate_on_insert=1 SELECT toUInt64(number), toString(number) FROM numbers(100) FORMAT Parquet on node1 (cluster.py:3564, query) 2025-04-02 03:05:05 [ 600 ] DEBUG : Command to send: m d o2156 e (clientserver.py:501, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Command to send: m d o2157 e (clientserver.py:501, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Command to send: m d o2158 e (clientserver.py:501, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Command to send: m d o2159 e (clientserver.py:501, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Command to send: m d o2160 e (clientserver.py:501, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Command to send: m d o2161 e (clientserver.py:501, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Command to send: m d o2162 e (clientserver.py:501, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Command to send: c o55 read e (clientserver.py:501, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Answer received: !yro2163 (clientserver.py:512, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Command to send: c o2163 load s/ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/database/user_files/test_filesystem_cache3xGH1RNBfl.parquet e (clientserver.py:501, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Answer received: !yro2164 (clientserver.py:512, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Command to send: c o2164 write e (clientserver.py:501, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Answer received: !yro2165 (clientserver.py:512, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Command to send: c o2165 mode soverwrite e (clientserver.py:501, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Answer received: !yro2166 (clientserver.py:512, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Command to send: c o2166 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Answer received: !yro2167 (clientserver.py:512, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Command to send: c o2167 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Answer received: !yro2168 (clientserver.py:512, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Command to send: c o2168 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Answer received: !yro2169 (clientserver.py:512, send_command) 2025-04-02 03:05:05 [ 600 ] DEBUG : Command to send: c o2169 save s/test_filesystem_cache3xGH1RNBfl e (clientserver.py:501, send_command) 2025-04-02 03:05:08 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:08 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_filesystem_cache3xGH1RNBfl/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:08 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_filesystem_cache3xGH1RNBfl/part-00000-fe59f1df-f154-4f56-9407-3d95f43a4b4a-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:08 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_filesystem_cache3xGH1RNBfl; CREATE TABLE test_filesystem_cache3xGH1RNBfl ENGINE=DeltaLake(s3, filename = 'test_filesystem_cache3xGH1RNBfl/', url = 'http://minio1:9001/root/') SETTINGS allow_experimental_delta_kernel_rs=1 on node1 (cluster.py:3564, query) _______________________________ test_metadata[0] _______________________________ started_cluster = use_delta_kernel = '0' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_metadata(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket TABLE_NAME = randomize_table_name("test_metadata") parquet_data_path = create_initial_data_file( started_cluster, instance, "SELECT number, toString(number) FROM numbers(100)", TABLE_NAME, ) write_delta_from_file(spark, parquet_data_path, f"/{TABLE_NAME}") upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") data = get_file_contents( minio_client, bucket, f"/{TABLE_NAME}/_delta_log/00000000000000000000.json", ) delta_metadata = get_delta_metadata(data) stats = json.loads(delta_metadata["add"]["stats"]) assert stats["numRecords"] == 100 assert next(iter(stats["minValues"].values())) == 0 assert next(iter(stats["maxValues"].values())) == 99 > create_delta_table(instance, TABLE_NAME, use_delta_kernel=use_delta_kernel) test_storage_delta/test.py:373: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_delta/test.py:152: in create_delta_table node.query( helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 56, stderr: Received exception from server (version 25.2.2): E Code: 56. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table engine DeltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Storages/StorageFactory.cpp:276: DB::StorageFactory::getStorageFeatures(String const&) const @ 0x000000002d62e3cc E 5. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:105: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr const&, std::shared_ptr) @ 0x000000002995251c E 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1124: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a015adc E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 8. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 9. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 11. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 13. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 14. asan_thread_start(void*) @ 0x000000000b6a3e77 E 15. ? @ 0x00007fa1c9941ac3 E 16. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_STORAGE) E (query: CREATE TABLE test_metadatalyMYzG01Fn E ENGINE=DeltaLake(s3, filename = 'test_metadatalyMYzG01Fn/', url = 'http://minio1:9001/root/') E SETTINGS allow_experimental_delta_kernel_rs=0) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:05:08 [ 600 ] DEBUG : Executing query INSERT INTO TABLE FUNCTION file('test_metadatalyMYzG01Fn.parquet') SETTINGS output_format_parquet_compression_method='none', s3_truncate_on_insert=1 SELECT number, toString(number) FROM numbers(100) FORMAT Parquet on node1 (cluster.py:3564, query) 2025-04-02 03:05:09 [ 600 ] DEBUG : Command to send: c o55 read e (clientserver.py:501, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Answer received: !yro2170 (clientserver.py:512, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Command to send: c o2170 load s/ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/database/user_files/test_metadatalyMYzG01Fn.parquet e (clientserver.py:501, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Answer received: !yro2171 (clientserver.py:512, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Command to send: c o2171 write e (clientserver.py:501, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Answer received: !yro2172 (clientserver.py:512, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Command to send: c o2172 mode soverwrite e (clientserver.py:501, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Answer received: !yro2173 (clientserver.py:512, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Command to send: c o2173 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Answer received: !yro2174 (clientserver.py:512, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Command to send: c o2174 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Answer received: !yro2175 (clientserver.py:512, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Command to send: c o2175 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Answer received: !yro2176 (clientserver.py:512, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Command to send: c o2176 save s/test_metadatalyMYzG01Fn e (clientserver.py:501, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Command to send: m d o2163 e (clientserver.py:501, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Command to send: m d o2164 e (clientserver.py:501, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Command to send: m d o2165 e (clientserver.py:501, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Command to send: m d o2166 e (clientserver.py:501, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Command to send: m d o2167 e (clientserver.py:501, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Command to send: m d o2168 e (clientserver.py:501, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Command to send: m d o2169 e (clientserver.py:501, send_command) 2025-04-02 03:05:09 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:11 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_metadatalyMYzG01Fn/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:11 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_metadatalyMYzG01Fn/part-00000-1274faf7-dd12-4c60-a11e-56852bb1cb76-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:11 [ 600 ] DEBUG : http://172.16.1.8:9001 "GET /root//test_metadatalyMYzG01Fn/_delta_log/00000000000000000000.json HTTP/1.1" 200 1636 (connectionpool.py:547, _make_request) 2025-04-02 03:05:11 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_metadatalyMYzG01Fn; CREATE TABLE test_metadatalyMYzG01Fn ENGINE=DeltaLake(s3, filename = 'test_metadatalyMYzG01Fn/', url = 'http://minio1:9001/root/') SETTINGS allow_experimental_delta_kernel_rs=0 on node1 (cluster.py:3564, query) _______________________________ test_metadata[1] _______________________________ started_cluster = use_delta_kernel = '1' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_metadata(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket TABLE_NAME = randomize_table_name("test_metadata") parquet_data_path = create_initial_data_file( started_cluster, instance, "SELECT number, toString(number) FROM numbers(100)", TABLE_NAME, ) write_delta_from_file(spark, parquet_data_path, f"/{TABLE_NAME}") upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") data = get_file_contents( minio_client, bucket, f"/{TABLE_NAME}/_delta_log/00000000000000000000.json", ) delta_metadata = get_delta_metadata(data) stats = json.loads(delta_metadata["add"]["stats"]) assert stats["numRecords"] == 100 assert next(iter(stats["minValues"].values())) == 0 assert next(iter(stats["maxValues"].values())) == 99 > create_delta_table(instance, TABLE_NAME, use_delta_kernel=use_delta_kernel) test_storage_delta/test.py:373: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_delta/test.py:152: in create_delta_table node.query( helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 56, stderr: Received exception from server (version 25.2.2): E Code: 56. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table engine DeltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Storages/StorageFactory.cpp:276: DB::StorageFactory::getStorageFeatures(String const&) const @ 0x000000002d62e3cc E 5. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:105: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr const&, std::shared_ptr) @ 0x000000002995251c E 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1124: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a015adc E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 8. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 9. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 11. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 13. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 14. asan_thread_start(void*) @ 0x000000000b6a3e77 E 15. ? @ 0x00007fa1c9941ac3 E 16. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_STORAGE) E (query: CREATE TABLE test_metadataQ806Py8KQX E ENGINE=DeltaLake(s3, filename = 'test_metadataQ806Py8KQX/', url = 'http://minio1:9001/root/') E SETTINGS allow_experimental_delta_kernel_rs=1) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:05:12 [ 600 ] DEBUG : Executing query INSERT INTO TABLE FUNCTION file('test_metadataQ806Py8KQX.parquet') SETTINGS output_format_parquet_compression_method='none', s3_truncate_on_insert=1 SELECT number, toString(number) FROM numbers(100) FORMAT Parquet on node1 (cluster.py:3564, query) 2025-04-02 03:05:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Command to send: m d o2174 e (clientserver.py:501, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Command to send: m d o2175 e (clientserver.py:501, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Command to send: m d o2176 e (clientserver.py:501, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Command to send: c o55 read e (clientserver.py:501, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Answer received: !yro2177 (clientserver.py:512, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Command to send: c o2177 load s/ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/database/user_files/test_metadataQ806Py8KQX.parquet e (clientserver.py:501, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Answer received: !yro2178 (clientserver.py:512, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Command to send: c o2178 write e (clientserver.py:501, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Answer received: !yro2179 (clientserver.py:512, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Command to send: c o2179 mode soverwrite e (clientserver.py:501, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Answer received: !yro2180 (clientserver.py:512, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Command to send: c o2180 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Answer received: !yro2181 (clientserver.py:512, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Command to send: c o2181 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Answer received: !yro2182 (clientserver.py:512, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Command to send: c o2182 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Answer received: !yro2183 (clientserver.py:512, send_command) 2025-04-02 03:05:12 [ 600 ] DEBUG : Command to send: c o2183 save s/test_metadataQ806Py8KQX e (clientserver.py:501, send_command) 2025-04-02 03:05:15 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:15 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_metadataQ806Py8KQX/part-00000-d4ae225d-c89c-4743-8368-fe84b6e6586c-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:15 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_metadataQ806Py8KQX/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:15 [ 600 ] DEBUG : http://172.16.1.8:9001 "GET /root//test_metadataQ806Py8KQX/_delta_log/00000000000000000000.json HTTP/1.1" 200 1636 (connectionpool.py:547, _make_request) 2025-04-02 03:05:15 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_metadataQ806Py8KQX; CREATE TABLE test_metadataQ806Py8KQX ENGINE=DeltaLake(s3, filename = 'test_metadataQ806Py8KQX/', url = 'http://minio1:9001/root/') SETTINGS allow_experimental_delta_kernel_rs=1 on node1 (cluster.py:3564, query) __________________________ test_multiple_log_files[0] __________________________ started_cluster = use_delta_kernel = '0' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_multiple_log_files(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket TABLE_NAME = randomize_table_name("test_multiple_log_files") write_delta_from_df( spark, generate_data(spark, 0, 100), f"/{TABLE_NAME}", mode="overwrite" ) files = upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") assert len(files) == 2 # 1 metadata files + 1 data file s3_objects = list( minio_client.list_objects(bucket, f"{TABLE_NAME}/_delta_log/", recursive=True) ) assert len(s3_objects) == 1 > create_delta_table(instance, TABLE_NAME, use_delta_kernel=use_delta_kernel) test_storage_delta/test.py:323: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_delta/test.py:152: in create_delta_table node.query( helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 56, stderr: Received exception from server (version 25.2.2): E Code: 56. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table engine DeltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Storages/StorageFactory.cpp:276: DB::StorageFactory::getStorageFeatures(String const&) const @ 0x000000002d62e3cc E 5. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:105: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr const&, std::shared_ptr) @ 0x000000002995251c E 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1124: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a015adc E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 8. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 9. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 11. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 13. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 14. asan_thread_start(void*) @ 0x000000000b6a3e77 E 15. ? @ 0x00007fa1c9941ac3 E 16. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_STORAGE) E (query: CREATE TABLE test_multiple_log_filespuH08jnxXM E ENGINE=DeltaLake(s3, filename = 'test_multiple_log_filespuH08jnxXM/', url = 'http://minio1:9001/root/') E SETTINGS allow_experimental_delta_kernel_rs=0) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2184 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2184 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o55 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2185 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ylo2186 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2186 add sa e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2186 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2187 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2185 toDF ro2187 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2188 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2189 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2189 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o55 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2190 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ylo2191 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2191 add sb e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2191 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2192 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2190 toDF ro2192 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2193 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2193 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2194 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2195 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2195 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2196 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2196 get e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2197 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2198 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yao2199 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2198 applyModifiableSettings ro2197 ro2199 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2200 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2194 cast ro2200 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2201 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2193 withColumn sb ro2201 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2202 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2203 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2204 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ylo2205 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2205 add ro2204 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2205 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2206 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro2206 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2207 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2203 over ro2207 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2208 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2188 withColumn srow_index ro2208 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2209 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2210 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2211 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ylo2212 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2212 add ro2211 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2212 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2213 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro2213 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2214 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2210 over ro2214 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2215 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2202 withColumn srow_index ro2215 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2216 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ylo2217 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2217 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2217 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2218 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2209 join ro2216 ro2218 sinner e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2219 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2219 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2220 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2220 write e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2221 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2221 mode soverwrite e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2222 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2222 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2223 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2223 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2224 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2224 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yro2225 (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: c o2225 save s/test_multiple_log_filespuH08jnxXM e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2177 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2178 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2179 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2180 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2181 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2182 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2183 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2186 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2191 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2199 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2205 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2212 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2184 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2185 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2187 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2188 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2189 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2190 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2192 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2193 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2194 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2195 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2196 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2198 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2200 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2201 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2202 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2203 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2204 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2206 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2207 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2208 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2210 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2211 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2213 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2214 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2215 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Command to send: m d o2217 e (clientserver.py:501, send_command) 2025-04-02 03:05:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:18 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:18 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_multiple_log_filespuH08jnxXM/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:18 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_multiple_log_filespuH08jnxXM/part-00000-6735ec43-cbb6-444b-bc0c-9b4e2474d73f-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:18 [ 600 ] DEBUG : http://172.16.1.8:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=test_multiple_log_filespuH08jnxXM%2F_delta_log%2F HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:18 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_multiple_log_filespuH08jnxXM; CREATE TABLE test_multiple_log_filespuH08jnxXM ENGINE=DeltaLake(s3, filename = 'test_multiple_log_filespuH08jnxXM/', url = 'http://minio1:9001/root/') SETTINGS allow_experimental_delta_kernel_rs=0 on node1 (cluster.py:3564, query) __________________________ test_multiple_log_files[1] __________________________ started_cluster = use_delta_kernel = '1' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_multiple_log_files(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket TABLE_NAME = randomize_table_name("test_multiple_log_files") write_delta_from_df( spark, generate_data(spark, 0, 100), f"/{TABLE_NAME}", mode="overwrite" ) files = upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") assert len(files) == 2 # 1 metadata files + 1 data file s3_objects = list( minio_client.list_objects(bucket, f"{TABLE_NAME}/_delta_log/", recursive=True) ) assert len(s3_objects) == 1 > create_delta_table(instance, TABLE_NAME, use_delta_kernel=use_delta_kernel) test_storage_delta/test.py:323: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_delta/test.py:152: in create_delta_table node.query( helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 56, stderr: Received exception from server (version 25.2.2): E Code: 56. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table engine DeltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Storages/StorageFactory.cpp:276: DB::StorageFactory::getStorageFeatures(String const&) const @ 0x000000002d62e3cc E 5. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:105: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr const&, std::shared_ptr) @ 0x000000002995251c E 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1124: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a015adc E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 8. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 9. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 11. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 13. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 14. asan_thread_start(void*) @ 0x000000000b6a3e77 E 15. ? @ 0x00007fa1c9941ac3 E 16. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_STORAGE) E (query: CREATE TABLE test_multiple_log_filesSzE61P622s E ENGINE=DeltaLake(s3, filename = 'test_multiple_log_filesSzE61P622s/', url = 'http://minio1:9001/root/') E SETTINGS allow_experimental_delta_kernel_rs=1) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2226 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2226 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o55 range i0 i100 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2227 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ylo2228 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2228 add sa e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2228 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2229 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2227 toDF ro2229 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2230 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2231 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2231 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o55 range i1 i101 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2232 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ylo2233 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2233 add sb e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2233 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2234 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2232 toDF ro2234 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2235 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2235 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2236 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2237 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2237 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2238 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2238 get e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2239 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2240 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yao2241 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2240 applyModifiableSettings ro2239 ro2241 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2242 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2236 cast ro2242 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2243 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2235 withColumn sb ro2243 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2244 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2245 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2246 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ylo2247 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2247 add ro2246 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2247 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2248 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro2248 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2249 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2245 over ro2249 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2250 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2230 withColumn srow_index ro2250 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2251 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2252 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2253 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ylo2254 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2254 add ro2253 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2254 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2255 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro2255 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2256 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2252 over ro2256 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2257 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2244 withColumn srow_index ro2257 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2258 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ylo2259 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2259 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2259 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2260 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2251 join ro2258 ro2260 sinner e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2261 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2261 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2262 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2262 write e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2263 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2263 mode soverwrite e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2264 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2264 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2265 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2265 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2266 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2266 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yro2267 (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: c o2267 save s/test_multiple_log_filesSzE61P622s e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2218 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2219 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2220 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2221 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2222 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2223 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2224 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2225 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2209 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2216 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2127 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2228 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2233 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2241 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2247 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2254 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2226 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2227 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2229 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2230 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2231 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2232 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2234 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2235 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2236 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2237 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2238 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2240 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2242 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2243 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2244 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2245 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2246 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2248 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2249 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2250 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2252 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2253 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2255 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2256 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2257 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Command to send: m d o2259 e (clientserver.py:501, send_command) 2025-04-02 03:05:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_multiple_log_filesSzE61P622s/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:22 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_multiple_log_filesSzE61P622s/part-00000-affe3f16-1ee7-4122-ab74-625be6162565-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:22 [ 600 ] DEBUG : http://172.16.1.8:9001 "GET /root?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=test_multiple_log_filesSzE61P622s%2F_delta_log%2F HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:22 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_multiple_log_filesSzE61P622s; CREATE TABLE test_multiple_log_filesSzE61P622s ENGINE=DeltaLake(s3, filename = 'test_multiple_log_filesSzE61P622s/', url = 'http://minio1:9001/root/') SETTINGS allow_experimental_delta_kernel_rs=1 on node1 (cluster.py:3564, query) _____________________________ test_partition_by[0] _____________________________ started_cluster = use_delta_kernel = '0' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_partition_by(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket TABLE_NAME = randomize_table_name("test_partition_by") write_delta_from_df( spark, generate_data(spark, 0, 10), f"/{TABLE_NAME}", mode="overwrite", partition_by="a", ) files = upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") assert len(files) == 11 # 10 partitions and 1 metadata file > create_delta_table(instance, TABLE_NAME, use_delta_kernel=use_delta_kernel) test_storage_delta/test.py:224: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_delta/test.py:152: in create_delta_table node.query( helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 56, stderr: Received exception from server (version 25.2.2): E Code: 56. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table engine DeltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Storages/StorageFactory.cpp:276: DB::StorageFactory::getStorageFeatures(String const&) const @ 0x000000002d62e3cc E 5. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:105: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr const&, std::shared_ptr) @ 0x000000002995251c E 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1124: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a015adc E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 8. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 9. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 11. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 13. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 14. asan_thread_start(void*) @ 0x000000000b6a3e77 E 15. ? @ 0x00007fa1c9941ac3 E 16. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_STORAGE) E (query: CREATE TABLE test_partition_by1GhAv9MvSf E ENGINE=DeltaLake(s3, filename = 'test_partition_by1GhAv9MvSf/', url = 'http://minio1:9001/root/') E SETTINGS allow_experimental_delta_kernel_rs=0) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2268 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2268 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o55 range i0 i10 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2269 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ylo2270 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2270 add sa e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2270 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2271 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2269 toDF ro2271 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2272 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2273 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2273 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o55 range i1 i11 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2274 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ylo2275 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2275 add sb e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2275 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: m d o2260 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2276 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2274 toDF ro2276 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: m d o2261 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: m d o2262 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: m d o2263 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: m d o2264 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2277 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2277 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: m d o2265 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2278 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: m d o2266 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: m d o2267 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: m d o2251 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: m d o2258 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: m d o2270 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: m d o2275 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2279 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2279 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2280 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2280 get e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2281 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2282 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yao2283 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2282 applyModifiableSettings ro2281 ro2283 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2284 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2278 cast ro2284 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2285 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2277 withColumn sb ro2285 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2286 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2287 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2288 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ylo2289 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2289 add ro2288 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2289 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2290 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro2290 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2291 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2287 over ro2291 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2292 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2272 withColumn srow_index ro2292 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2293 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2294 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2295 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ylo2296 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2296 add ro2295 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2296 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2297 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro2297 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2298 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2294 over ro2298 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2299 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2286 withColumn srow_index ro2299 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2300 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ylo2301 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2301 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2301 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2302 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2293 join ro2300 ro2302 sinner e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2303 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2303 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2304 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2304 write e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2305 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2305 mode soverwrite e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2306 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2306 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2307 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2307 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2308 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2308 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2309 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ylo2310 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2310 add sa e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2310 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2311 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2309 partitionBy ro2311 e (clientserver.py:501, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Answer received: !yro2312 (clientserver.py:512, send_command) 2025-04-02 03:05:22 [ 600 ] DEBUG : Command to send: c o2312 save s/test_partition_by1GhAv9MvSf e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2283 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2289 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2296 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2268 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2269 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2271 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2272 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2273 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2274 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2276 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2277 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2278 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2279 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2280 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2282 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2284 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2285 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2286 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2287 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2288 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2290 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2291 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2292 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2294 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2295 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2297 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2298 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2299 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2301 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Command to send: m d o2310 e (clientserver.py:501, send_command) 2025-04-02 03:05:23 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:25 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:25 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_by1GhAv9MvSf/col-1a524b7e-66ef-4d5d-b90e-9eceece0ef4a%3D9/part-00000-0d640aed-1ad7-4303-952a-3b75b3beabd1.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:25 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_by1GhAv9MvSf/col-1a524b7e-66ef-4d5d-b90e-9eceece0ef4a%3D3/part-00000-e80eed85-9e55-4751-903a-f98cab80363e.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:25 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_by1GhAv9MvSf/col-1a524b7e-66ef-4d5d-b90e-9eceece0ef4a%3D5/part-00000-d923b72d-907c-4043-9c32-ed107ff1ad47.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:25 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_by1GhAv9MvSf/col-1a524b7e-66ef-4d5d-b90e-9eceece0ef4a%3D0/part-00000-d4f920c4-ad50-49b5-91a0-8726d67910ec.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:25 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_by1GhAv9MvSf/col-1a524b7e-66ef-4d5d-b90e-9eceece0ef4a%3D1/part-00000-1270f8b7-0bc7-4026-bb46-e0ce4b83dade.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:25 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_by1GhAv9MvSf/col-1a524b7e-66ef-4d5d-b90e-9eceece0ef4a%3D2/part-00000-dd3aa6c8-b2a4-415f-bf60-5a447953cf9f.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:25 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_by1GhAv9MvSf/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:25 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_by1GhAv9MvSf/col-1a524b7e-66ef-4d5d-b90e-9eceece0ef4a%3D7/part-00000-794804ec-b3b7-4000-b715-dc2ee8a6fe30.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:25 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_by1GhAv9MvSf/col-1a524b7e-66ef-4d5d-b90e-9eceece0ef4a%3D6/part-00000-98fa66dc-16bc-42f5-8b5e-30cf29928e17.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:25 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_by1GhAv9MvSf/col-1a524b7e-66ef-4d5d-b90e-9eceece0ef4a%3D8/part-00000-bab6a485-d2e0-4edb-ad2f-88954ae7d483.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:25 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_by1GhAv9MvSf/col-1a524b7e-66ef-4d5d-b90e-9eceece0ef4a%3D4/part-00000-9817d22d-6d5c-43bb-bd2c-ed787f3d8d98.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:25 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_partition_by1GhAv9MvSf; CREATE TABLE test_partition_by1GhAv9MvSf ENGINE=DeltaLake(s3, filename = 'test_partition_by1GhAv9MvSf/', url = 'http://minio1:9001/root/') SETTINGS allow_experimental_delta_kernel_rs=0 on node1 (cluster.py:3564, query) _____________________________ test_partition_by[1] _____________________________ started_cluster = use_delta_kernel = '1' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_partition_by(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket TABLE_NAME = randomize_table_name("test_partition_by") write_delta_from_df( spark, generate_data(spark, 0, 10), f"/{TABLE_NAME}", mode="overwrite", partition_by="a", ) files = upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") assert len(files) == 11 # 10 partitions and 1 metadata file > create_delta_table(instance, TABLE_NAME, use_delta_kernel=use_delta_kernel) test_storage_delta/test.py:224: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_delta/test.py:152: in create_delta_table node.query( helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 56, stderr: Received exception from server (version 25.2.2): E Code: 56. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table engine DeltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Storages/StorageFactory.cpp:276: DB::StorageFactory::getStorageFeatures(String const&) const @ 0x000000002d62e3cc E 5. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:105: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr const&, std::shared_ptr) @ 0x000000002995251c E 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1124: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a015adc E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 8. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 9. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 11. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 13. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 14. asan_thread_start(void*) @ 0x000000000b6a3e77 E 15. ? @ 0x00007fa1c9941ac3 E 16. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_STORAGE) E (query: CREATE TABLE test_partition_bytJth7SsUiS E ENGINE=DeltaLake(s3, filename = 'test_partition_bytJth7SsUiS/', url = 'http://minio1:9001/root/') E SETTINGS allow_experimental_delta_kernel_rs=1) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2313 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2313 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o55 range i0 i10 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2314 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ylo2315 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2315 add sa e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2315 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2316 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2314 toDF ro2316 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2317 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2318 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2318 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o55 range i1 i11 i1 i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2319 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ylo2320 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2320 add sb e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2320 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2321 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2319 toDF ro2321 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2322 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2322 apply sb e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2323 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2324 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2324 isDefined e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2325 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2325 get e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2326 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u SparkSession$ rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession$ (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession$ MODULE$ e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2327 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yao2328 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2327 applyModifiableSettings ro2326 ro2328 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o55 parseDataType s"string" e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2329 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2323 cast ro2329 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2330 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2322 withColumn sb ro2330 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2331 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2332 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2333 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ylo2334 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2334 add ro2333 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2334 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2335 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro2335 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2336 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2332 over ro2336 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2337 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2317 withColumn srow_index ro2337 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2338 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions row_number e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2339 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u functions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.functions (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.functions monotonically_increasing_id e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2340 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u org.apache.spark.sql.expressions.Window rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.expressions.Window (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.expressions.Window orderBy e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ylo2341 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2341 add ro2340 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2341 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2342 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.expressions.Window orderBy ro2342 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2343 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2339 over ro2343 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2344 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2331 withColumn srow_index ro2344 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2345 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ylo2346 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2346 add srow_index e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2346 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2347 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2338 join ro2345 ro2347 sinner e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2348 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2348 drop srow_index e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2349 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2349 write e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2350 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2350 mode soverwrite e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2351 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2351 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2352 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2352 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2353 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2353 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2354 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ylo2355 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2355 add sa e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2355 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2356 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2354 partitionBy ro2356 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yro2357 (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: c o2357 save s/test_partition_bytJth7SsUiS e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2302 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2303 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2304 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2305 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2306 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2307 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2308 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2309 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2311 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2312 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2197 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2239 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2293 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2300 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2315 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2320 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2328 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2334 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2341 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2313 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2314 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2316 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2317 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2318 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2319 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2321 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2322 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2323 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2324 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2325 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2327 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2329 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2330 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2331 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2332 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2333 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2335 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2336 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2337 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2339 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2340 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2342 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2343 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2344 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2346 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Command to send: m d o2355 e (clientserver.py:501, send_command) 2025-04-02 03:05:26 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:29 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:29 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_bytJth7SsUiS/col-dabc4c82-ff50-461a-9b8f-8b659bd55953%3D6/part-00000-897cff5f-050d-4e3b-adeb-bd1311364ec2.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:29 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_bytJth7SsUiS/col-dabc4c82-ff50-461a-9b8f-8b659bd55953%3D9/part-00000-e44da050-b843-4197-acfa-e9180328afe2.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:29 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_bytJth7SsUiS/col-dabc4c82-ff50-461a-9b8f-8b659bd55953%3D4/part-00000-8ac0d736-2354-4354-8979-3d97b12461cd.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:29 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_bytJth7SsUiS/col-dabc4c82-ff50-461a-9b8f-8b659bd55953%3D5/part-00000-17ec0a74-e584-4566-bc3f-805888c01fcd.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:29 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_bytJth7SsUiS/col-dabc4c82-ff50-461a-9b8f-8b659bd55953%3D2/part-00000-3f68f39e-29eb-4db9-a73a-52374a760ca0.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:29 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_bytJth7SsUiS/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:29 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_bytJth7SsUiS/col-dabc4c82-ff50-461a-9b8f-8b659bd55953%3D7/part-00000-1b47fce1-a112-4a14-b350-2107259f2321.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:29 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_bytJth7SsUiS/col-dabc4c82-ff50-461a-9b8f-8b659bd55953%3D1/part-00000-aa8ec13a-dde9-4ced-a1ec-baa460a46a03.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:29 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_bytJth7SsUiS/col-dabc4c82-ff50-461a-9b8f-8b659bd55953%3D0/part-00000-63a49d54-c13b-42a9-acff-80ce14d75ada.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:29 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_bytJth7SsUiS/col-dabc4c82-ff50-461a-9b8f-8b659bd55953%3D3/part-00000-9b60fa1e-9e9c-4b8c-85de-22f138b0c984.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:29 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_bytJth7SsUiS/col-dabc4c82-ff50-461a-9b8f-8b659bd55953%3D8/part-00000-69e6cfd1-39ff-49dd-80e5-7e6bf2998ecd.c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:29 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_partition_bytJth7SsUiS; CREATE TABLE test_partition_bytJth7SsUiS ENGINE=DeltaLake(s3, filename = 'test_partition_bytJth7SsUiS/', url = 'http://minio1:9001/root/') SETTINGS allow_experimental_delta_kernel_rs=1 on node1 (cluster.py:3564, query) __________________________ test_partition_columns[0] ___________________________ started_cluster = use_delta_kernel = '0' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_partition_columns(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket TABLE_NAME = randomize_table_name("test_partition_columns") result_file = f"{TABLE_NAME}" partition_columns = ["b", "c", "d", "e"] delta_table = ( DeltaTable.create(spark) .tableName(TABLE_NAME) .location(f"/{result_file}") .addColumn("a", "INT") .addColumn("b", "STRING") .addColumn("c", "DATE") .addColumn("d", "INT") .addColumn("e", "BOOLEAN") .partitionedBy(partition_columns) .execute() ) num_rows = 9 schema = StructType( [ StructField("a", IntegerType()), StructField("b", StringType()), StructField("c", DateType()), StructField("d", IntegerType()), StructField("e", BooleanType()), ] ) for i in range(1, num_rows + 1): data = [ ( i, "test" + str(i), datetime.strptime(f"2000-01-0{i}", "%Y-%m-%d"), i, False if i % 2 == 0 else True, ) ] df = spark.createDataFrame(data=data, schema=schema) df.printSchema() df.write.mode("append").format("delta").partitionBy(partition_columns).save( f"/{TABLE_NAME}" ) minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket files = upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") assert len(files) > 0 print(f"Uploaded files: {files}") > result = instance.query( f"describe table deltaLake('http://{started_cluster.minio_ip}:{started_cluster.minio_port}/{bucket}/{result_file}/', 'minio', 'minio123', SETTINGS allow_experimental_delta_kernel_rs={use_delta_kernel})" ).strip() test_storage_delta/test.py:628: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 46, stderr: Received exception from server (version 25.2.2): E Code: 46. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table function deltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/TableFunctions/TableFunctionFactory.cpp:50: DB::TableFunctionFactory::get(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002599a46c E 5. ./build_docker/./src/Interpreters/InterpreterDescribeQuery.cpp:157: DB::InterpreterDescribeQuery::fillColumnsFromTableFunction(DB::ASTTableExpression const&) @ 0x000000002a0d1b75 E 6. ./build_docker/./src/Interpreters/InterpreterDescribeQuery.cpp:102: DB::InterpreterDescribeQuery::execute() @ 0x000000002a0d003f E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1458: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a01ae63 E 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 9. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 10. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 12. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 14. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 15. asan_thread_start(void*) @ 0x000000000b6a3e77 E 16. ? @ 0x00007fa1c9941ac3 E 17. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_FUNCTION) E (query: describe table deltaLake('http://172.16.1.8:9001/root/test_partition_columnsucoIbUwOdl/', 'minio', 'minio123', SETTINGS allow_experimental_delta_kernel_rs=0)) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable create e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable create ro55 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2358 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2358 tableName stest_partition_columnsucoIbUwOdl e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2359 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2359 location s/test_partition_columnsucoIbUwOdl e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2360 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sa e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2361 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2361 dataType sINT e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2362 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2362 nullable bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2363 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2363 build e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2364 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2360 addColumn ro2364 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2365 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sb e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2366 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2366 dataType sSTRING e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2367 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2367 nullable bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2368 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2368 build e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2369 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2365 addColumn ro2369 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2370 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2371 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2371 dataType sDATE e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2372 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2372 nullable bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2373 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2373 build e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2374 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2370 addColumn ro2374 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2375 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sd e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2376 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2376 dataType sINT e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2377 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2377 nullable bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2378 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2378 build e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2379 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2375 addColumn ro2379 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2380 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 se e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2381 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2381 dataType sBOOLEAN e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2382 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2382 nullable bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2383 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2383 build e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2384 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2380 addColumn ro2384 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2385 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ylo2386 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2386 add sb e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2386 add sc e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2386 add sd e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2386 add se e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2386 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2387 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2385 partitionedBy ro2387 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yro2388 (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: c o2388 execute e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: m d o2347 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: m d o2348 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: m d o2349 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: m d o2350 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: m d o2351 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: m d o2352 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: m d o2353 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: m d o2354 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: m d o2356 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: m d o2357 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: m d o2338 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: m d o2345 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Command to send: m d o2386 e (clientserver.py:501, send_command) 2025-04-02 03:05:30 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2389 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2390 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2390 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmp66z_7dvc i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2391 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2391 id e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yi2102 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2391 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2392 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2392 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yao2393 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2393 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ylo2394 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ylo2395 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2393 ro2394 spython3 s3.10 ro2395 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2396 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2391 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2397 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2397 ro2396 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2398 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2398 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2399 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2399 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2400 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2400 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2401 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2401 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2402 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2402 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2403 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2403 schema e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2404 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2404 treeString e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2403 write e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2405 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2405 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2406 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2406 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2407 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ylo2408 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2408 add sb e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2408 add sc e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2408 add sd e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2408 add se e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2408 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2409 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2407 partitionBy ro2409 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yro2410 (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: c o2410 save s/test_partition_columnsucoIbUwOdl e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2358 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2359 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2360 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2361 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2362 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2363 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2364 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2365 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2366 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2367 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2368 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2369 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2370 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2371 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2372 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2373 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2374 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2375 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2376 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2377 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2378 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2379 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2380 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2381 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2382 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2383 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2384 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2385 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2387 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2388 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2393 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2394 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2395 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Command to send: m d o2408 e (clientserver.py:501, send_command) 2025-04-02 03:05:33 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2411 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2411 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmp5c3bdhme i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2412 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2412 id e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yi2131 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2412 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2413 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2413 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yao2414 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2414 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ylo2415 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ylo2416 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2414 ro2415 spython3 s3.10 ro2416 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2417 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2412 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2418 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2418 ro2417 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2419 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2419 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2420 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2420 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2421 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2421 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2422 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2422 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2423 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2423 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2424 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2424 schema e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2425 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2425 treeString e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2424 write e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2426 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2426 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2427 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2427 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2428 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ylo2429 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2429 add sb e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2429 add sc e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2429 add sd e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2429 add se e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2429 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2430 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2428 partitionBy ro2430 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yro2431 (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: c o2431 save s/test_partition_columnsucoIbUwOdl e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2390 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2391 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2392 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2396 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2397 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2398 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2399 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2400 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2401 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2402 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2404 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2405 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2406 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2407 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2409 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2410 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2414 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2415 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2416 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Command to send: m d o2429 e (clientserver.py:501, send_command) 2025-04-02 03:05:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2432 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2432 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmpfd6z2w26 i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2433 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2433 id e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yi2160 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2433 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2434 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2434 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yao2435 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2435 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ylo2436 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ylo2437 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2435 ro2436 spython3 s3.10 ro2437 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2438 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2433 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2439 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2439 ro2438 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2440 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2440 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2441 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2441 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2442 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2442 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2443 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2443 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2444 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2444 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2445 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2445 schema e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2446 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2446 treeString e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2445 write e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2447 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2447 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2448 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2448 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2449 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ylo2450 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2450 add sb e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2450 add sc e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2450 add sd e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2450 add se e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2450 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2451 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2449 partitionBy ro2451 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yro2452 (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: c o2452 save s/test_partition_columnsucoIbUwOdl e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2435 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2436 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2437 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2411 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2412 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2413 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2417 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2418 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2419 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2420 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2421 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2422 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2423 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2424 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2425 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2426 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2427 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2428 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2430 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2431 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2432 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2433 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2434 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2438 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2439 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2440 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2441 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2442 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2443 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2444 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2446 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2447 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2448 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Command to send: m d o2450 e (clientserver.py:501, send_command) 2025-04-02 03:05:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2453 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2453 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmpbcr18b_b i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2454 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2454 id e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yi2189 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2454 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2455 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2455 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yao2456 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2456 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ylo2457 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ylo2458 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2456 ro2457 spython3 s3.10 ro2458 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2459 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2454 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2460 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2460 ro2459 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2461 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2461 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2462 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2462 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2463 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2463 e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2464 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2464 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2465 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2465 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2466 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2466 schema e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2467 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2467 treeString e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2466 write e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2468 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2468 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2469 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2469 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2470 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ylo2471 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2471 add sb e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2471 add sc e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2471 add sd e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2471 add se e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2471 e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2472 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2470 partitionBy ro2472 e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yro2473 (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: c o2473 save s/test_partition_columnsucoIbUwOdl e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: m d o2456 e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: m d o2457 e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: m d o2458 e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Command to send: m d o2471 e (clientserver.py:501, send_command) 2025-04-02 03:05:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2474 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2474 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmp33zm9bfc i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2475 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2475 id e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yi2218 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2475 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2476 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2476 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yao2477 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2477 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ylo2478 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ylo2479 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2477 ro2478 spython3 s3.10 ro2479 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2480 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2475 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2481 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2481 ro2480 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2482 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2482 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2483 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2483 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2484 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2484 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2485 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2485 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2486 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2486 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2487 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2487 schema e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2488 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2488 treeString e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2487 write e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2489 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2489 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2490 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2490 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2491 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ylo2492 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2492 add sb e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2492 add sc e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2492 add sd e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2492 add se e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2492 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2493 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2491 partitionBy ro2493 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yro2494 (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: c o2494 save s/test_partition_columnsucoIbUwOdl e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2403 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2449 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2445 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2451 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2452 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2453 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2454 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2455 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2459 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2460 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2461 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2462 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2463 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2464 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2465 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2467 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2468 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2469 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2470 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2472 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2473 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2474 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2476 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2477 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2478 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2479 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Command to send: m d o2492 e (clientserver.py:501, send_command) 2025-04-02 03:05:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2495 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2495 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmp13apfen8 i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2496 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2496 id e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yi2247 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2496 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2497 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2497 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yao2498 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2498 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ylo2499 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ylo2500 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2498 ro2499 spython3 s3.10 ro2500 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2501 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2496 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2502 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2502 ro2501 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2503 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2503 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2504 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2504 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2505 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2505 e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2506 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2506 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2507 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2507 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2508 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2508 schema e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2509 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2509 treeString e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2508 write e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2510 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2510 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2511 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2511 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2512 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ylo2513 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2513 add sb e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2513 add sc e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2513 add sd e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2513 add se e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2513 e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2514 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2512 partitionBy ro2514 e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yro2515 (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: c o2515 save s/test_partition_columnsucoIbUwOdl e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: m d o2498 e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: m d o2499 e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: m d o2500 e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Command to send: m d o2513 e (clientserver.py:501, send_command) 2025-04-02 03:05:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2516 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2516 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmpm3iwbb7u i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2517 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2517 id e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yi2276 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2517 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2518 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2518 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yao2519 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2519 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ylo2520 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ylo2521 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2519 ro2520 spython3 s3.10 ro2521 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2522 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2517 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2523 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2523 ro2522 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2524 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2524 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2525 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2525 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2526 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2526 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2527 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2527 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2528 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2528 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2529 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2529 schema e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2530 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2530 treeString e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2529 write e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2531 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2531 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2532 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2532 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2533 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ylo2534 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2534 add sb e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2534 add sc e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2534 add sd e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2534 add se e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2534 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2535 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2533 partitionBy ro2535 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yro2536 (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: c o2536 save s/test_partition_columnsucoIbUwOdl e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2480 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2481 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2482 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2483 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2484 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2485 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2486 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2487 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2488 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2489 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2490 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2491 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2493 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2494 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2495 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2496 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2497 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2501 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2502 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2503 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2504 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2505 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2506 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2507 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2509 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2510 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2511 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2512 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2514 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2515 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2519 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2520 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2521 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Command to send: m d o2534 e (clientserver.py:501, send_command) 2025-04-02 03:05:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2537 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2537 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmpu667hc5t i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2538 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2538 id e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yi2305 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2538 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2539 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2539 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yao2540 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2540 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ylo2541 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ylo2542 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2540 ro2541 spython3 s3.10 ro2542 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2543 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2538 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2544 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2544 ro2543 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2545 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2545 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2546 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2546 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2547 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2547 e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2548 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2548 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2549 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2549 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2550 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2550 schema e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2551 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2551 treeString e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2550 write e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2552 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2552 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2553 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2553 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2554 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ylo2555 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2555 add sb e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2555 add sc e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2555 add sd e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2555 add se e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2555 e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2556 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2554 partitionBy ro2556 e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yro2557 (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: c o2557 save s/test_partition_columnsucoIbUwOdl e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: m d o2540 e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: m d o2541 e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: m d o2542 e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Command to send: m d o2555 e (clientserver.py:501, send_command) 2025-04-02 03:05:53 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2558 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2558 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmplz327y4h i1 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2559 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2559 id e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yi2334 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2559 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2560 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2560 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yao2561 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2561 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ylo2562 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ylo2563 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2561 ro2562 spython3 s3.10 ro2563 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2564 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2559 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2565 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2565 ro2564 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2566 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2566 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2567 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2567 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2568 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2568 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2569 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2569 rdd e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2570 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2570 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2571 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2571 schema e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2572 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2572 treeString e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2571 write e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2573 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2573 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2574 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2574 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2575 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ylo2576 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2576 add sb e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2576 add sc e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2576 add sd e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2576 add se e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2576 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2577 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2575 partitionBy ro2577 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yro2578 (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: c o2578 save s/test_partition_columnsucoIbUwOdl e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2517 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2518 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2522 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2523 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2524 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2525 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2526 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2527 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2528 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2529 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2530 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2531 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2532 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2533 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2535 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2536 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2537 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2538 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2539 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2543 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2544 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2545 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2546 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2547 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2548 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2549 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2551 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2552 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2553 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2554 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2556 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2557 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2561 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2562 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2563 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Command to send: m d o2576 e (clientserver.py:501, send_command) 2025-04-02 03:05:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/b%3Dtest8/c%3D2000-01-08/d%3D8/e%3Dfalse/part-00000-02971798-01bb-4076-bcc8-6f9085a06224.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/b%3Dtest7/c%3D2000-01-07/d%3D7/e%3Dtrue/part-00000-1b95407a-0579-4a54-a7a5-2936871fe076.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/b%3Dtest2/c%3D2000-01-02/d%3D2/e%3Dfalse/part-00000-a392cf9e-34db-409a-a4b6-d029c89b61b3.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000007.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000003.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000008.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000001.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000004.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000002.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000005.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000006.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/_delta_log/00000000000000000009.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/b%3Dtest1/c%3D2000-01-01/d%3D1/e%3Dtrue/part-00000-3768c845-ed78-4a98-b109-52b15d0b8658.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/b%3Dtest4/c%3D2000-01-04/d%3D4/e%3Dfalse/part-00000-62546bf9-6f6c-4ea9-851a-61a4cff70bf6.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/b%3Dtest6/c%3D2000-01-06/d%3D6/e%3Dfalse/part-00000-fa180caa-e229-4ffe-9b9b-41b055c7c3ca.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/b%3Dtest5/c%3D2000-01-05/d%3D5/e%3Dtrue/part-00000-2b8b01c4-4f83-4909-bfd4-01de80a569cb.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/b%3Dtest9/c%3D2000-01-09/d%3D9/e%3Dtrue/part-00000-41cd9b47-2cf9-4251-b1f9-62cca33a8a11.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsucoIbUwOdl/b%3Dtest3/c%3D2000-01-03/d%3D3/e%3Dtrue/part-00000-0aea69d0-2f52-40a9-90a5-23a770c9a9a6.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:05:59 [ 600 ] DEBUG : Executing query describe table deltaLake('http://172.16.1.8:9001/root/test_partition_columnsucoIbUwOdl/', 'minio', 'minio123', SETTINGS allow_experimental_delta_kernel_rs=0) on node1 (cluster.py:3564, query) __________________________ test_partition_columns[1] ___________________________ started_cluster = use_delta_kernel = '1' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_partition_columns(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket TABLE_NAME = randomize_table_name("test_partition_columns") result_file = f"{TABLE_NAME}" partition_columns = ["b", "c", "d", "e"] delta_table = ( DeltaTable.create(spark) .tableName(TABLE_NAME) .location(f"/{result_file}") .addColumn("a", "INT") .addColumn("b", "STRING") .addColumn("c", "DATE") .addColumn("d", "INT") .addColumn("e", "BOOLEAN") .partitionedBy(partition_columns) .execute() ) num_rows = 9 schema = StructType( [ StructField("a", IntegerType()), StructField("b", StringType()), StructField("c", DateType()), StructField("d", IntegerType()), StructField("e", BooleanType()), ] ) for i in range(1, num_rows + 1): data = [ ( i, "test" + str(i), datetime.strptime(f"2000-01-0{i}", "%Y-%m-%d"), i, False if i % 2 == 0 else True, ) ] df = spark.createDataFrame(data=data, schema=schema) df.printSchema() df.write.mode("append").format("delta").partitionBy(partition_columns).save( f"/{TABLE_NAME}" ) minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket files = upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") assert len(files) > 0 print(f"Uploaded files: {files}") > result = instance.query( f"describe table deltaLake('http://{started_cluster.minio_ip}:{started_cluster.minio_port}/{bucket}/{result_file}/', 'minio', 'minio123', SETTINGS allow_experimental_delta_kernel_rs={use_delta_kernel})" ).strip() test_storage_delta/test.py:628: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 46, stderr: Received exception from server (version 25.2.2): E Code: 46. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table function deltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/TableFunctions/TableFunctionFactory.cpp:50: DB::TableFunctionFactory::get(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002599a46c E 5. ./build_docker/./src/Interpreters/InterpreterDescribeQuery.cpp:157: DB::InterpreterDescribeQuery::fillColumnsFromTableFunction(DB::ASTTableExpression const&) @ 0x000000002a0d1b75 E 6. ./build_docker/./src/Interpreters/InterpreterDescribeQuery.cpp:102: DB::InterpreterDescribeQuery::execute() @ 0x000000002a0d003f E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1458: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a01ae63 E 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 9. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 10. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 11. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 12. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 13. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 14. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 15. asan_thread_start(void*) @ 0x000000000b6a3e77 E 16. ? @ 0x00007fa1c9941ac3 E 17. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_FUNCTION) E (query: describe table deltaLake('http://172.16.1.8:9001/root/test_partition_columnsstmhN6lkyb/', 'minio', 'minio123', SETTINGS allow_experimental_delta_kernel_rs=1)) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable create e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable create ro55 e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2579 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2579 tableName stest_partition_columnsstmhN6lkyb e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2580 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2580 location s/test_partition_columnsstmhN6lkyb e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2581 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sa e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2582 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2582 dataType sINT e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2583 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2583 nullable bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2584 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2584 build e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2585 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2581 addColumn ro2585 e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2586 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sb e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2587 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2587 dataType sSTRING e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2588 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2588 nullable bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2589 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2589 build e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2590 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2586 addColumn ro2590 e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2591 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sc e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2592 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2592 dataType sDATE e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2593 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2593 nullable bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2594 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2594 build e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2595 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2591 addColumn ro2595 e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2596 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sd e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2597 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2597 dataType sINT e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2598 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2598 nullable bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2599 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2599 build e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2600 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2596 addColumn ro2600 e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2601 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 se e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2602 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2602 dataType sBOOLEAN e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2603 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2603 nullable bTrue e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2604 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2604 build e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2605 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2601 addColumn ro2605 e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2606 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ylo2607 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2607 add sb e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2607 add sc e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2607 add sd e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2607 add se e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2607 e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2608 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2606 partitionedBy ro2608 e (clientserver.py:501, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Answer received: !yro2609 (clientserver.py:512, send_command) 2025-04-02 03:05:59 [ 600 ] DEBUG : Command to send: c o2609 execute e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2558 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2559 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2560 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2564 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2565 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2566 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2567 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2568 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2569 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2570 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2572 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2573 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2574 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2575 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2577 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2578 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2516 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2508 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2550 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2281 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2466 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2475 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2607 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2579 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2580 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2581 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2582 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2583 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2584 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2585 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2586 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2587 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2588 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2589 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2590 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2591 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2592 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2593 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2594 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2595 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2596 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2597 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2598 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2599 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2600 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2601 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2602 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2603 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2604 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2605 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2606 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Command to send: m d o2608 e (clientserver.py:501, send_command) 2025-04-02 03:06:00 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2610 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2611 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2611 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmpcv9hjjyn i1 e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2612 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2612 id e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yi2387 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2612 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2613 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2613 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yao2614 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2614 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ylo2615 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ylo2616 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2614 ro2615 spython3 s3.10 ro2616 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2617 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2612 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2618 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2618 ro2617 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2619 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2619 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2620 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2620 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2621 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2621 e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2622 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2622 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2623 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2623 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2624 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2624 schema e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2625 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2625 treeString e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2624 write e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2626 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2626 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2627 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2627 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2628 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ylo2629 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2629 add sb e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2629 add sc e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2629 add sd e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2629 add se e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2629 e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2630 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2628 partitionBy ro2630 e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yro2631 (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: c o2631 save s/test_partition_columnsstmhN6lkyb e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: m d o2614 e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: m d o2615 e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: m d o2616 e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Command to send: m d o2629 e (clientserver.py:501, send_command) 2025-04-02 03:06:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2632 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2632 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmpugbtd1c_ i1 e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2633 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2633 id e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yi2416 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2633 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2634 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2634 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yao2635 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2635 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ylo2636 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ylo2637 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2635 ro2636 spython3 s3.10 ro2637 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2638 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2633 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2639 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2639 ro2638 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2640 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2640 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2641 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2641 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2642 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2642 e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2643 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2643 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2644 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2644 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2645 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2645 schema e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2646 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2646 treeString e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2645 write e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2647 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2647 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2648 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2648 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2649 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ylo2650 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2650 add sb e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2650 add sc e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2650 add sd e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2650 add se e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2650 e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2651 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2649 partitionBy ro2651 e (clientserver.py:501, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Answer received: !yro2652 (clientserver.py:512, send_command) 2025-04-02 03:06:04 [ 600 ] DEBUG : Command to send: c o2652 save s/test_partition_columnsstmhN6lkyb e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2611 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2612 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2613 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2617 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2618 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2619 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2620 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2621 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2622 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2623 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2625 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2626 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2627 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2628 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2630 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2631 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2632 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2634 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2635 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2636 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2637 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Command to send: m d o2650 e (clientserver.py:501, send_command) 2025-04-02 03:06:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2653 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2653 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmp8bm_womh i1 e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2654 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2654 id e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yi2445 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2654 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2655 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2655 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yao2656 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2656 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ylo2657 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ylo2658 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2656 ro2657 spython3 s3.10 ro2658 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2659 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2654 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2660 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2660 ro2659 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2661 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2661 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2662 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2662 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2663 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2663 e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2664 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2664 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2665 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2665 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2666 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2666 schema e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2667 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2667 treeString e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2666 write e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2668 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2668 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2669 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2669 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2670 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ylo2671 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2671 add sb e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2671 add sc e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2671 add sd e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2671 add se e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2671 e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2672 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2670 partitionBy ro2672 e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yro2673 (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: c o2673 save s/test_partition_columnsstmhN6lkyb e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: m d o2656 e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: m d o2657 e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: m d o2658 e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Command to send: m d o2671 e (clientserver.py:501, send_command) 2025-04-02 03:06:08 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2674 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2674 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmptsbinnn4 i1 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2675 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2675 id e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yi2474 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2675 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2676 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2676 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yao2677 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2677 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ylo2678 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ylo2679 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2677 ro2678 spython3 s3.10 ro2679 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2680 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2675 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2681 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2681 ro2680 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2682 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2682 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2683 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2683 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2684 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2684 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2685 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2685 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2686 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2686 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2687 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2687 schema e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2688 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2688 treeString e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2687 write e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2689 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2689 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2690 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2690 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2691 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ylo2692 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2692 add sb e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2692 add sc e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2692 add sd e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2692 add se e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2692 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2693 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2691 partitionBy ro2693 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yro2694 (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: c o2694 save s/test_partition_columnsstmhN6lkyb e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2638 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2639 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2640 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2641 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2642 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2643 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2644 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2645 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2646 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2647 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2648 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2649 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2651 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2652 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2653 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2654 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2655 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2659 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2660 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2661 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2662 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2663 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2664 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2665 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2667 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2668 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2669 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2670 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2672 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2673 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2677 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2678 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2679 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Command to send: m d o2692 e (clientserver.py:501, send_command) 2025-04-02 03:06:11 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2695 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2695 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmpw47l13jm i1 e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2696 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2696 id e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yi2503 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2696 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2697 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2697 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yao2698 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2698 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ylo2699 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ylo2700 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2698 ro2699 spython3 s3.10 ro2700 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2701 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2696 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2702 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2702 ro2701 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2703 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2703 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2704 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2704 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2705 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2705 e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2706 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2706 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2707 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2707 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2708 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2708 schema e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2709 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2709 treeString e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2708 write e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2710 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2710 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2711 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2711 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2712 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ylo2713 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2713 add sb e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2713 add sc e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2713 add sd e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2713 add se e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2713 e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2714 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2712 partitionBy ro2714 e (clientserver.py:501, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Answer received: !yro2715 (clientserver.py:512, send_command) 2025-04-02 03:06:13 [ 600 ] DEBUG : Command to send: c o2715 save s/test_partition_columnsstmhN6lkyb e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2698 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2699 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2700 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2713 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2674 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2675 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2676 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2680 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2681 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2682 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2683 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2684 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2685 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2686 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2687 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2688 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2689 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2690 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2691 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2693 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2694 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2695 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2696 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2697 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2701 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2702 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2703 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2704 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2705 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2706 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2707 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2709 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2710 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2711 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2712 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Command to send: m d o2714 e (clientserver.py:501, send_command) 2025-04-02 03:06:14 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2716 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2716 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmpx_im5zdk i1 e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2717 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2717 id e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yi2532 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2717 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2718 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2718 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yao2719 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2719 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ylo2720 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ylo2721 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2719 ro2720 spython3 s3.10 ro2721 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2722 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2717 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2723 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2723 ro2722 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2724 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2724 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2725 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2725 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2726 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2726 e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2727 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2727 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2728 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2728 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2729 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2729 schema e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2730 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2730 treeString e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2729 write e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2731 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2731 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2732 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2732 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2733 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ylo2734 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2734 add sb e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2734 add sc e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2734 add sd e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2734 add se e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2734 e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2735 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2733 partitionBy ro2735 e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yro2736 (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: c o2736 save s/test_partition_columnsstmhN6lkyb e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: m d o2719 e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: m d o2720 e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: m d o2721 e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Command to send: m d o2734 e (clientserver.py:501, send_command) 2025-04-02 03:06:16 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2737 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2737 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmp5o5gf9xn i1 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2738 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2738 id e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yi2561 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2738 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2739 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2739 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yao2740 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2740 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ylo2741 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ylo2742 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2740 ro2741 spython3 s3.10 ro2742 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2743 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2738 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2744 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2744 ro2743 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2745 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2745 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2746 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2746 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2747 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2747 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2748 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2748 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2749 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2749 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2750 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2750 schema e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2751 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2751 treeString e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2750 write e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2752 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2752 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2753 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2753 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2754 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ylo2755 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2755 add sb e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2755 add sc e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2755 add sd e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2755 add se e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2755 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2756 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2754 partitionBy ro2756 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yro2757 (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: c o2757 save s/test_partition_columnsstmhN6lkyb e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2716 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2717 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2718 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2722 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2723 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2724 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2725 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2726 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2727 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2728 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2730 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2731 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2732 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2733 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2735 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2736 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2737 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2739 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2740 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2741 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2742 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Command to send: m d o2755 e (clientserver.py:501, send_command) 2025-04-02 03:06:19 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2758 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2758 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmpolpeoyz7 i1 e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2759 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2759 id e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yi2590 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2759 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2760 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2760 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yao2761 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2761 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ylo2762 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ylo2763 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2761 ro2762 spython3 s3.10 ro2763 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2764 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2759 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2765 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2765 ro2764 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2766 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2766 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2767 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2767 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2768 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2768 e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2769 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2769 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2770 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2770 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2771 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2771 schema e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2772 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2772 treeString e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2771 write e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2773 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2773 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2774 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2774 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2775 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ylo2776 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2776 add sb e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2776 add sc e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2776 add sd e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2776 add se e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2776 e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2777 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2775 partitionBy ro2777 e (clientserver.py:501, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Answer received: !yro2778 (clientserver.py:512, send_command) 2025-04-02 03:06:21 [ 600 ] DEBUG : Command to send: c o2778 save s/test_partition_columnsstmhN6lkyb e (clientserver.py:501, send_command) 2025-04-02 03:06:22 [ 600 ] DEBUG : Command to send: m d o2761 e (clientserver.py:501, send_command) 2025-04-02 03:06:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:22 [ 600 ] DEBUG : Command to send: m d o2762 e (clientserver.py:501, send_command) 2025-04-02 03:06:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:22 [ 600 ] DEBUG : Command to send: m d o2763 e (clientserver.py:501, send_command) 2025-04-02 03:06:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:22 [ 600 ] DEBUG : Command to send: m d o2776 e (clientserver.py:501, send_command) 2025-04-02 03:06:22 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2779 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2779 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmp6hpwf9p4 i1 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2780 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2780 id e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yi2619 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2780 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2781 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2781 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yao2782 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2782 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ylo2783 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ylo2784 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2782 ro2783 spython3 s3.10 ro2784 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2785 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2780 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2786 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2786 ro2785 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2787 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2787 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2788 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2788 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2789 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2789 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2790 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2790 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2791 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2791 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":true,"type":"string"},{"metadata":{},"name":"c","nullable":true,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":"integer"},{"metadata":{},"name":"e","nullable":true,"type":"boolean"}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2792 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2792 schema e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2793 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2793 treeString e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = true)\n |-- c: date (nullable = true)\n |-- d: integer (nullable = true)\n |-- e: boolean (nullable = true)\n (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2792 write e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2794 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2794 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2795 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2795 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2796 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils toSeq e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ylo2797 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2797 add sb e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2797 add sc e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2797 add sd e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2797 add se e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils toSeq ro2797 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2798 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2796 partitionBy ro2798 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yro2799 (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: c o2799 save s/test_partition_columnsstmhN6lkyb e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2743 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2744 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2745 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2746 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2747 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2748 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2749 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2750 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2751 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2752 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2753 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2754 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2756 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2757 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2758 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2759 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2760 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2764 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2765 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2766 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2767 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2768 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2769 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2770 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2772 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2773 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2774 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2775 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2777 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2778 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2779 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2782 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2783 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2784 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Command to send: m d o2797 e (clientserver.py:501, send_command) 2025-04-02 03:06:24 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:27 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/b%3Dtest8/c%3D2000-01-08/d%3D8/e%3Dfalse/part-00000-cc4c0b43-28c8-4a0c-a09d-c1828500c6e4.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/b%3Dtest7/c%3D2000-01-07/d%3D7/e%3Dtrue/part-00000-19cca5a5-28fb-4a4f-8523-b79f4df4b859.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/b%3Dtest2/c%3D2000-01-02/d%3D2/e%3Dfalse/part-00000-c8ef70c4-c34d-45ad-a9e4-ab25786165bc.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000007.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000003.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000008.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000001.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000004.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000002.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000005.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000006.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/_delta_log/00000000000000000009.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/b%3Dtest1/c%3D2000-01-01/d%3D1/e%3Dtrue/part-00000-d3b95943-0e27-4e1f-9cc0-4764bb5f3c08.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/b%3Dtest4/c%3D2000-01-04/d%3D4/e%3Dfalse/part-00000-3c6523b2-fef6-4e79-825e-c2f52fa26b2b.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/b%3Dtest6/c%3D2000-01-06/d%3D6/e%3Dfalse/part-00000-46acb1f7-7b4e-4f4c-af0b-f5f5b1cef829.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/b%3Dtest5/c%3D2000-01-05/d%3D5/e%3Dtrue/part-00000-814be19a-5881-4c33-970b-7c6b602473a3.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/b%3Dtest9/c%3D2000-01-09/d%3D9/e%3Dtrue/part-00000-8f5c3964-c70b-45ba-93ac-6dfb96a79b3a.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_partition_columnsstmhN6lkyb/b%3Dtest3/c%3D2000-01-03/d%3D3/e%3Dtrue/part-00000-6d443123-f3e2-4839-b068-dce75c639dbe.c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:27 [ 600 ] DEBUG : Executing query describe table deltaLake('http://172.16.1.8:9001/root/test_partition_columnsstmhN6lkyb/', 'minio', 'minio123', SETTINGS allow_experimental_delta_kernel_rs=1) on node1 (cluster.py:3564, query) ________________ test_replicated_database_and_unavailable_s3[0] ________________ started_cluster = use_delta_kernel = '0' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_replicated_database_and_unavailable_s3(started_cluster, use_delta_kernel): node1 = started_cluster.instances["node1"] node2 = started_cluster.instances["node2"] DB_NAME = randomize_table_name("db") TABLE_NAME = randomize_table_name("test_replicated_database_and_unavailable_s3") minio_client = started_cluster.minio_client bucket = started_cluster.minio_restricted_bucket if not minio_client.bucket_exists(bucket): minio_client.make_bucket(bucket) node1.query( f"CREATE DATABASE {DB_NAME} ENGINE=Replicated('/clickhouse/databases/{DB_NAME}', 'shard1', 'node1')" ) node2.query( f"CREATE DATABASE {DB_NAME} ENGINE=Replicated('/clickhouse/databases/{DB_NAME}', 'shard1', 'node2')" ) parquet_data_path = create_initial_data_file( started_cluster, node1, "SELECT number, toString(number) FROM numbers(100)", TABLE_NAME, ) endpoint_url = f"http://{started_cluster.minio_ip}:{started_cluster.minio_port}" aws_access_key_id = "minio" aws_secret_access_key = "minio123" schema = pa.schema( [ ("id", pa.int32()), ("name", pa.string()), ] ) data = [ pa.array([1, 2, 3], type=pa.int32()), pa.array(["John Doe", "Jane Smith", "Jake Johnson"], type=pa.string()), ] storage_options = { "AWS_ENDPOINT_URL": endpoint_url, "AWS_ACCESS_KEY_ID": aws_access_key_id, "AWS_SECRET_ACCESS_KEY": aws_secret_access_key, "AWS_ALLOW_HTTP": "true", "AWS_S3_ALLOW_UNSAFE_RENAME": "true", } path = f"s3://root/{TABLE_NAME}" table = pa.Table.from_arrays(data, schema=schema) write_deltalake(path, table, storage_options=storage_options) with PartitionManager() as pm: pm_rule_reject = { "probability": 1, "destination": node2.ip_address, "source_port": started_cluster.minio_port, "action": "REJECT --reject-with tcp-reset", } pm_rule_drop_all = { "destination": node2.ip_address, "source_port": started_cluster.minio_port, "action": "DROP", } pm._add_rule(pm_rule_reject) > node1.query( f""" DROP TABLE IF EXISTS {DB_NAME}.{TABLE_NAME}; CREATE TABLE {DB_NAME}.{TABLE_NAME} AS deltaLake('http://{started_cluster.minio_ip}:{started_cluster.minio_port}/root/{TABLE_NAME}' , 'minio', 'minio123') """ ) test_storage_delta/test.py:998: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 46, stderr: Received exception from server (version 25.2.2): E Code: 46. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table function deltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/TableFunctions/TableFunctionFactory.cpp:50: DB::TableFunctionFactory::get(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002599a46c E 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:972: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&, DB::LoadingStrictnessLevel) const @ 0x00000000296c3ade E 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1658: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000296d6064 E 7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:2331: DB::InterpreterCreateQuery::execute() @ 0x00000000296f1d98 E 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1458: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a01ae63 E 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 10. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 11. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 13. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 15. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 16. asan_thread_start(void*) @ 0x000000000b6a3e77 E 17. ? @ 0x00007fa1c9941ac3 E 18. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_FUNCTION) E (query: CREATE TABLE dbxbHydY1R4B.test_replicated_database_and_unavailable_s3EuLSB8219C E AS deltaLake('http://172.16.1.8:9001/root/test_replicated_database_and_unavailable_s3EuLSB8219C' , 'minio', 'minio123') E ) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:06:28 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Command to send: m d o2633 e (clientserver.py:501, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Command to send: m d o2666 e (clientserver.py:501, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Command to send: m d o2715 e (clientserver.py:501, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : http://172.16.1.8:9001 "HEAD /root-with-auth HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:28 [ 600 ] DEBUG : Executing query CREATE DATABASE dbxbHydY1R4B ENGINE=Replicated('/clickhouse/databases/dbxbHydY1R4B', 'shard1', 'node1') on node1 (cluster.py:3564, query) 2025-04-02 03:06:28 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Command to send: m d o2708 e (clientserver.py:501, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Command to send: m d o2729 e (clientserver.py:501, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Command to send: m d o2738 e (clientserver.py:501, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Command to send: m d o2771 e (clientserver.py:501, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Command to send: m d o2571 e (clientserver.py:501, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Command to send: m d o2389 e (clientserver.py:501, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Command to send: m d o2609 e (clientserver.py:501, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:28 [ 600 ] DEBUG : Executing query CREATE DATABASE dbxbHydY1R4B ENGINE=Replicated('/clickhouse/databases/dbxbHydY1R4B', 'shard1', 'node2') on node2 (cluster.py:3564, query) 2025-04-02 03:06:28 [ 600 ] DEBUG : Executing query INSERT INTO TABLE FUNCTION file('test_replicated_database_and_unavailable_s3EuLSB8219C.parquet') SETTINGS output_format_parquet_compression_method='none', s3_truncate_on_insert=1 SELECT number, toString(number) FROM numbers(100) FORMAT Parquet on node1 (cluster.py:3564, query) 2025-04-02 03:06:29 [ 600 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-04-02 03:06:29 [ 600 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-04-02 03:06:29 [ 600 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-04-02 03:06:29 [ 600 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-04-02 03:06:29 [ 600 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:547, _make_request) 2025-04-02 03:06:29 [ 600 ] DEBUG : http://localhost:None "POST /v1.46/containers/create HTTP/1.1" 201 88 (connectionpool.py:547, _make_request) 2025-04-02 03:06:29 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/63eb2cb193ab0b62703547c60911e92bb2628908e09338f2bb3467325e1e89ed/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:06:29 [ 600 ] DEBUG : http://localhost:None "POST /v1.46/containers/63eb2cb193ab0b62703547c60911e92bb2628908e09338f2bb3467325e1e89ed/start HTTP/1.1" 204 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:29 [ 600 ] DEBUG : [network] Created new container 63eb2cb193ab0b62703547c60911e92bb2628908e09338f2bb3467325e1e89ed (network.py:406, _ensure_container) 2025-04-02 03:06:29 [ 600 ] DEBUG : http://localhost:None "POST /v1.46/containers/63eb2cb193ab0b62703547c60911e92bb2628908e09338f2bb3467325e1e89ed/exec HTTP/1.1" 201 74 (connectionpool.py:547, _make_request) 2025-04-02 03:06:29 [ 600 ] DEBUG : http://localhost:None "POST /v1.46/exec/1e61554974f9b70f879ffc9ed4cc5f63e1bb5a3e7069f887f017ea8ab86b3316/start HTTP/1.1" 101 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:29 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/exec/1e61554974f9b70f879ffc9ed4cc5f63e1bb5a3e7069f887f017ea8ab86b3316/json HTTP/1.1" 200 545 (connectionpool.py:547, _make_request) 2025-04-02 03:06:29 [ 600 ] DEBUG : [network] 63eb2cb193ab0b62703547c60911e92bb2628908e09338f2bb3467325e1e89ed: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-m', 'statistic', '--mode', 'random', '--probability', '1', '-p', 'tcp', '-d', '172.16.1.10', '--sport', '9001', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): (network.py:425, _exec_run) 2025-04-02 03:06:29 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS dbxbHydY1R4B.test_replicated_database_and_unavailable_s3EuLSB8219C; CREATE TABLE dbxbHydY1R4B.test_replicated_database_and_unavailable_s3EuLSB8219C AS deltaLake('http://172.16.1.8:9001/root/test_replicated_database_and_unavailable_s3EuLSB8219C' , 'minio', 'minio123') on node1 (cluster.py:3564, query) 2025-04-02 03:06:29 [ 600 ] DEBUG : http://localhost:None "POST /v1.46/containers/63eb2cb193ab0b62703547c60911e92bb2628908e09338f2bb3467325e1e89ed/exec HTTP/1.1" 201 74 (connectionpool.py:547, _make_request) 2025-04-02 03:06:29 [ 600 ] DEBUG : http://localhost:None "POST /v1.46/exec/f1ebd8eeaaa68c68d597e9891de888bd226e4b5d6e5d6fff5ba081eb47105d55/start HTTP/1.1" 101 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:29 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/exec/f1ebd8eeaaa68c68d597e9891de888bd226e4b5d6e5d6fff5ba081eb47105d55/json HTTP/1.1" 200 541 (connectionpool.py:547, _make_request) 2025-04-02 03:06:29 [ 600 ] DEBUG : [network] 63eb2cb193ab0b62703547c60911e92bb2628908e09338f2bb3467325e1e89ed: ['iptables', '--wait', '-D', 'DOCKER-USER', '-m', 'statistic', '--mode', 'random', '--probability', '1', '-p', 'tcp', '-d', '172.16.1.10', '--sport', '9001', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): (network.py:425, _exec_run) ________________ test_replicated_database_and_unavailable_s3[1] ________________ started_cluster = use_delta_kernel = '1' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_replicated_database_and_unavailable_s3(started_cluster, use_delta_kernel): node1 = started_cluster.instances["node1"] node2 = started_cluster.instances["node2"] DB_NAME = randomize_table_name("db") TABLE_NAME = randomize_table_name("test_replicated_database_and_unavailable_s3") minio_client = started_cluster.minio_client bucket = started_cluster.minio_restricted_bucket if not minio_client.bucket_exists(bucket): minio_client.make_bucket(bucket) node1.query( f"CREATE DATABASE {DB_NAME} ENGINE=Replicated('/clickhouse/databases/{DB_NAME}', 'shard1', 'node1')" ) node2.query( f"CREATE DATABASE {DB_NAME} ENGINE=Replicated('/clickhouse/databases/{DB_NAME}', 'shard1', 'node2')" ) parquet_data_path = create_initial_data_file( started_cluster, node1, "SELECT number, toString(number) FROM numbers(100)", TABLE_NAME, ) endpoint_url = f"http://{started_cluster.minio_ip}:{started_cluster.minio_port}" aws_access_key_id = "minio" aws_secret_access_key = "minio123" schema = pa.schema( [ ("id", pa.int32()), ("name", pa.string()), ] ) data = [ pa.array([1, 2, 3], type=pa.int32()), pa.array(["John Doe", "Jane Smith", "Jake Johnson"], type=pa.string()), ] storage_options = { "AWS_ENDPOINT_URL": endpoint_url, "AWS_ACCESS_KEY_ID": aws_access_key_id, "AWS_SECRET_ACCESS_KEY": aws_secret_access_key, "AWS_ALLOW_HTTP": "true", "AWS_S3_ALLOW_UNSAFE_RENAME": "true", } path = f"s3://root/{TABLE_NAME}" table = pa.Table.from_arrays(data, schema=schema) write_deltalake(path, table, storage_options=storage_options) with PartitionManager() as pm: pm_rule_reject = { "probability": 1, "destination": node2.ip_address, "source_port": started_cluster.minio_port, "action": "REJECT --reject-with tcp-reset", } pm_rule_drop_all = { "destination": node2.ip_address, "source_port": started_cluster.minio_port, "action": "DROP", } pm._add_rule(pm_rule_reject) > node1.query( f""" DROP TABLE IF EXISTS {DB_NAME}.{TABLE_NAME}; CREATE TABLE {DB_NAME}.{TABLE_NAME} AS deltaLake('http://{started_cluster.minio_ip}:{started_cluster.minio_port}/root/{TABLE_NAME}' , 'minio', 'minio123') """ ) test_storage_delta/test.py:998: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 46, stderr: Received exception from server (version 25.2.2): E Code: 46. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table function deltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/TableFunctions/TableFunctionFactory.cpp:50: DB::TableFunctionFactory::get(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002599a46c E 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:972: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&, DB::LoadingStrictnessLevel) const @ 0x00000000296c3ade E 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1658: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000296d6064 E 7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:2331: DB::InterpreterCreateQuery::execute() @ 0x00000000296f1d98 E 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1458: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a01ae63 E 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 10. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 11. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 13. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 15. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 16. asan_thread_start(void*) @ 0x000000000b6a3e77 E 17. ? @ 0x00007fa1c9941ac3 E 18. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_FUNCTION) E (query: CREATE TABLE dbicszmgNwwX.test_replicated_database_and_unavailable_s3BAzezbCvci E AS deltaLake('http://172.16.1.8:9001/root/test_replicated_database_and_unavailable_s3BAzezbCvci' , 'minio', 'minio123') E ) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:06:30 [ 600 ] DEBUG : http://172.16.1.8:9001 "HEAD /root-with-auth HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:30 [ 600 ] DEBUG : Executing query CREATE DATABASE dbicszmgNwwX ENGINE=Replicated('/clickhouse/databases/dbicszmgNwwX', 'shard1', 'node1') on node1 (cluster.py:3564, query) 2025-04-02 03:06:30 [ 600 ] DEBUG : Executing query CREATE DATABASE dbicszmgNwwX ENGINE=Replicated('/clickhouse/databases/dbicszmgNwwX', 'shard1', 'node2') on node2 (cluster.py:3564, query) 2025-04-02 03:06:30 [ 600 ] DEBUG : Executing query INSERT INTO TABLE FUNCTION file('test_replicated_database_and_unavailable_s3BAzezbCvci.parquet') SETTINGS output_format_parquet_compression_method='none', s3_truncate_on_insert=1 SELECT number, toString(number) FROM numbers(100) FORMAT Parquet on node1 (cluster.py:3564, query) 2025-04-02 03:06:31 [ 600 ] DEBUG : http://localhost:None "POST /v1.46/containers/63eb2cb193ab0b62703547c60911e92bb2628908e09338f2bb3467325e1e89ed/exec HTTP/1.1" 201 74 (connectionpool.py:547, _make_request) 2025-04-02 03:06:31 [ 600 ] DEBUG : http://localhost:None "POST /v1.46/exec/96561e08cb7ddc58da62e7f56885b4ea2842414f1921fb376e42eaeee2f7756c/start HTTP/1.1" 101 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:31 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/exec/96561e08cb7ddc58da62e7f56885b4ea2842414f1921fb376e42eaeee2f7756c/json HTTP/1.1" 200 545 (connectionpool.py:547, _make_request) 2025-04-02 03:06:31 [ 600 ] DEBUG : [network] 63eb2cb193ab0b62703547c60911e92bb2628908e09338f2bb3467325e1e89ed: ['iptables', '--wait', '-I', 'DOCKER-USER', '1', '-m', 'statistic', '--mode', 'random', '--probability', '1', '-p', 'tcp', '-d', '172.16.1.10', '--sport', '9001', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): (network.py:425, _exec_run) 2025-04-02 03:06:31 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS dbicszmgNwwX.test_replicated_database_and_unavailable_s3BAzezbCvci; CREATE TABLE dbicszmgNwwX.test_replicated_database_and_unavailable_s3BAzezbCvci AS deltaLake('http://172.16.1.8:9001/root/test_replicated_database_and_unavailable_s3BAzezbCvci' , 'minio', 'minio123') on node1 (cluster.py:3564, query) 2025-04-02 03:06:31 [ 600 ] DEBUG : http://localhost:None "POST /v1.46/containers/63eb2cb193ab0b62703547c60911e92bb2628908e09338f2bb3467325e1e89ed/exec HTTP/1.1" 201 74 (connectionpool.py:547, _make_request) 2025-04-02 03:06:31 [ 600 ] DEBUG : http://localhost:None "POST /v1.46/exec/828a1905cb9124149cba3ee7a3434f45465fb416c040e0234374f55584b3a4e3/start HTTP/1.1" 101 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:31 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/exec/828a1905cb9124149cba3ee7a3434f45465fb416c040e0234374f55584b3a4e3/json HTTP/1.1" 200 541 (connectionpool.py:547, _make_request) 2025-04-02 03:06:31 [ 600 ] DEBUG : [network] 63eb2cb193ab0b62703547c60911e92bb2628908e09338f2bb3467325e1e89ed: ['iptables', '--wait', '-D', 'DOCKER-USER', '-m', 'statistic', '--mode', 'random', '--probability', '1', '-p', 'tcp', '-d', '172.16.1.10', '--sport', '9001', '-j', 'REJECT', '--reject-with', 'tcp-reset'] (0): (network.py:425, _exec_run) ____________________________ test_restart_broken[0] ____________________________ started_cluster = use_delta_kernel = '0' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_restart_broken(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client bucket = "broken" TABLE_NAME = randomize_table_name("test_restart_broken") if not minio_client.bucket_exists(bucket): minio_client.make_bucket(bucket) parquet_data_path = create_initial_data_file( started_cluster, instance, "SELECT number, toString(number) FROM numbers(100)", TABLE_NAME, ) write_delta_from_file(spark, parquet_data_path, f"/{TABLE_NAME}") upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") > create_delta_table(instance, TABLE_NAME, bucket=bucket, use_delta_kernel=use_delta_kernel) test_storage_delta/test.py:474: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_delta/test.py:152: in create_delta_table node.query( helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 56, stderr: Received exception from server (version 25.2.2): E Code: 56. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table engine DeltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Storages/StorageFactory.cpp:276: DB::StorageFactory::getStorageFeatures(String const&) const @ 0x000000002d62e3cc E 5. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:105: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr const&, std::shared_ptr) @ 0x000000002995251c E 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1124: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a015adc E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 8. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 9. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 11. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 13. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 14. asan_thread_start(void*) @ 0x000000000b6a3e77 E 15. ? @ 0x00007fa1c9941ac3 E 16. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_STORAGE) E (query: CREATE TABLE test_restart_brokenRY6TYAyR7w E ENGINE=DeltaLake(s3, filename = 'test_restart_brokenRY6TYAyR7w/', url = 'http://minio1:9001/broken/') E SETTINGS allow_experimental_delta_kernel_rs=0) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:06:31 [ 600 ] DEBUG : http://172.16.1.8:9001 "GET /broken?location= HTTP/1.1" 404 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:31 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /broken HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:31 [ 600 ] DEBUG : Executing query INSERT INTO TABLE FUNCTION file('test_restart_brokenRY6TYAyR7w.parquet') SETTINGS output_format_parquet_compression_method='none', s3_truncate_on_insert=1 SELECT number, toString(number) FROM numbers(100) FORMAT Parquet on node1 (cluster.py:3564, query) 2025-04-02 03:06:32 [ 600 ] DEBUG : Command to send: c o55 read e (clientserver.py:501, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Answer received: !yro2800 (clientserver.py:512, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Command to send: c o2800 load s/ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/database/user_files/test_restart_brokenRY6TYAyR7w.parquet e (clientserver.py:501, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Command to send: m d o2792 e (clientserver.py:501, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Command to send: m d o2610 e (clientserver.py:501, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Answer received: !yro2801 (clientserver.py:512, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Command to send: c o2801 write e (clientserver.py:501, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Answer received: !yro2802 (clientserver.py:512, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Command to send: c o2802 mode soverwrite e (clientserver.py:501, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Answer received: !yro2803 (clientserver.py:512, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Command to send: c o2803 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Answer received: !yro2804 (clientserver.py:512, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Command to send: c o2804 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Answer received: !yro2805 (clientserver.py:512, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Command to send: c o2805 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Answer received: !yro2806 (clientserver.py:512, send_command) 2025-04-02 03:06:32 [ 600 ] DEBUG : Command to send: c o2806 save s/test_restart_brokenRY6TYAyR7w e (clientserver.py:501, send_command) 2025-04-02 03:06:34 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:34 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /broken//test_restart_brokenRY6TYAyR7w/part-00000-59e4fb93-c9d1-4604-9020-e0d3a7f63015-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:34 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /broken//test_restart_brokenRY6TYAyR7w/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:34 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_restart_brokenRY6TYAyR7w; CREATE TABLE test_restart_brokenRY6TYAyR7w ENGINE=DeltaLake(s3, filename = 'test_restart_brokenRY6TYAyR7w/', url = 'http://minio1:9001/broken/') SETTINGS allow_experimental_delta_kernel_rs=0 on node1 (cluster.py:3564, query) ____________________________ test_restart_broken[1] ____________________________ started_cluster = use_delta_kernel = '1' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_restart_broken(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client bucket = "broken" TABLE_NAME = randomize_table_name("test_restart_broken") if not minio_client.bucket_exists(bucket): minio_client.make_bucket(bucket) parquet_data_path = create_initial_data_file( started_cluster, instance, "SELECT number, toString(number) FROM numbers(100)", TABLE_NAME, ) write_delta_from_file(spark, parquet_data_path, f"/{TABLE_NAME}") upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") > create_delta_table(instance, TABLE_NAME, bucket=bucket, use_delta_kernel=use_delta_kernel) test_storage_delta/test.py:474: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_delta/test.py:152: in create_delta_table node.query( helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 56, stderr: Received exception from server (version 25.2.2): E Code: 56. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table engine DeltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Storages/StorageFactory.cpp:276: DB::StorageFactory::getStorageFeatures(String const&) const @ 0x000000002d62e3cc E 5. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:105: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr const&, std::shared_ptr) @ 0x000000002995251c E 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1124: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a015adc E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 8. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 9. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 11. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 13. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 14. asan_thread_start(void*) @ 0x000000000b6a3e77 E 15. ? @ 0x00007fa1c9941ac3 E 16. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_STORAGE) E (query: CREATE TABLE test_restart_brokenkVG4ID4ihY E ENGINE=DeltaLake(s3, filename = 'test_restart_brokenkVG4ID4ihY/', url = 'http://minio1:9001/broken/') E SETTINGS allow_experimental_delta_kernel_rs=1) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:06:35 [ 600 ] DEBUG : http://172.16.1.8:9001 "HEAD /broken HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:35 [ 600 ] DEBUG : Executing query INSERT INTO TABLE FUNCTION file('test_restart_brokenkVG4ID4ihY.parquet') SETTINGS output_format_parquet_compression_method='none', s3_truncate_on_insert=1 SELECT number, toString(number) FROM numbers(100) FORMAT Parquet on node1 (cluster.py:3564, query) 2025-04-02 03:06:35 [ 600 ] DEBUG : Command to send: c o55 read e (clientserver.py:501, send_command) 2025-04-02 03:06:35 [ 600 ] DEBUG : Answer received: !yro2807 (clientserver.py:512, send_command) 2025-04-02 03:06:35 [ 600 ] DEBUG : Command to send: c o2807 load s/ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/database/user_files/test_restart_brokenkVG4ID4ihY.parquet e (clientserver.py:501, send_command) 2025-04-02 03:06:35 [ 600 ] DEBUG : Answer received: !yro2808 (clientserver.py:512, send_command) 2025-04-02 03:06:35 [ 600 ] DEBUG : Command to send: c o2808 write e (clientserver.py:501, send_command) 2025-04-02 03:06:35 [ 600 ] DEBUG : Answer received: !yro2809 (clientserver.py:512, send_command) 2025-04-02 03:06:35 [ 600 ] DEBUG : Command to send: c o2809 mode soverwrite e (clientserver.py:501, send_command) 2025-04-02 03:06:35 [ 600 ] DEBUG : Answer received: !yro2810 (clientserver.py:512, send_command) 2025-04-02 03:06:35 [ 600 ] DEBUG : Command to send: c o2810 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:06:35 [ 600 ] DEBUG : Answer received: !yro2811 (clientserver.py:512, send_command) 2025-04-02 03:06:35 [ 600 ] DEBUG : Command to send: c o2811 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:06:35 [ 600 ] DEBUG : Answer received: !yro2812 (clientserver.py:512, send_command) 2025-04-02 03:06:35 [ 600 ] DEBUG : Command to send: c o2812 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:06:35 [ 600 ] DEBUG : Answer received: !yro2813 (clientserver.py:512, send_command) 2025-04-02 03:06:35 [ 600 ] DEBUG : Command to send: c o2813 save s/test_restart_brokenkVG4ID4ihY e (clientserver.py:501, send_command) 2025-04-02 03:06:36 [ 600 ] DEBUG : Command to send: m d o2800 e (clientserver.py:501, send_command) 2025-04-02 03:06:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:36 [ 600 ] DEBUG : Command to send: m d o2801 e (clientserver.py:501, send_command) 2025-04-02 03:06:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:36 [ 600 ] DEBUG : Command to send: m d o2802 e (clientserver.py:501, send_command) 2025-04-02 03:06:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:36 [ 600 ] DEBUG : Command to send: m d o2803 e (clientserver.py:501, send_command) 2025-04-02 03:06:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:36 [ 600 ] DEBUG : Command to send: m d o2804 e (clientserver.py:501, send_command) 2025-04-02 03:06:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:36 [ 600 ] DEBUG : Command to send: m d o2805 e (clientserver.py:501, send_command) 2025-04-02 03:06:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:36 [ 600 ] DEBUG : Command to send: m d o2806 e (clientserver.py:501, send_command) 2025-04-02 03:06:36 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:38 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:38 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /broken//test_restart_brokenkVG4ID4ihY/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:38 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /broken//test_restart_brokenkVG4ID4ihY/part-00000-5f654852-1c02-40ce-ba8a-69be9c2d6b8a-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:38 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_restart_brokenkVG4ID4ihY; CREATE TABLE test_restart_brokenkVG4ID4ihY ENGINE=DeltaLake(s3, filename = 'test_restart_brokenkVG4ID4ihY/', url = 'http://minio1:9001/broken/') SETTINGS allow_experimental_delta_kernel_rs=1 on node1 (cluster.py:3564, query) ____________________ test_restart_broken_table_function[0] _____________________ started_cluster = use_delta_kernel = '0' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_restart_broken_table_function(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client bucket = "broken2" TABLE_NAME = randomize_table_name("test_restart_broken_table_function") if not minio_client.bucket_exists(bucket): minio_client.make_bucket(bucket) parquet_data_path = create_initial_data_file( started_cluster, instance, "SELECT number, toString(number) FROM numbers(100)", TABLE_NAME, ) write_delta_from_file(spark, parquet_data_path, f"/{TABLE_NAME}") upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") > instance.query( f""" DROP TABLE IF EXISTS {TABLE_NAME}; CREATE TABLE {TABLE_NAME} AS deltaLake(s3, filename = '{TABLE_NAME}/', url = 'http://minio1:9001/{bucket}/')""" ) test_storage_delta/test.py:536: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 46, stderr: Received exception from server (version 25.2.2): E Code: 46. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table function deltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/TableFunctions/TableFunctionFactory.cpp:50: DB::TableFunctionFactory::get(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002599a46c E 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:972: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&, DB::LoadingStrictnessLevel) const @ 0x00000000296c3ade E 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1658: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000296d6064 E 7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:2331: DB::InterpreterCreateQuery::execute() @ 0x00000000296f1d98 E 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1458: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a01ae63 E 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 10. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 11. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 13. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 15. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 16. asan_thread_start(void*) @ 0x000000000b6a3e77 E 17. ? @ 0x00007fa1c9941ac3 E 18. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_FUNCTION) E (query: CREATE TABLE test_restart_broken_table_functionaWgvbMXO3N E AS deltaLake(s3, filename = 'test_restart_broken_table_functionaWgvbMXO3N/', url = 'http://minio1:9001/broken2/')) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:06:39 [ 600 ] DEBUG : Command to send: m d o2807 e (clientserver.py:501, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Command to send: m d o2808 e (clientserver.py:501, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : http://172.16.1.8:9001 "GET /broken2?location= HTTP/1.1" 404 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Command to send: m d o2809 e (clientserver.py:501, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Command to send: m d o2810 e (clientserver.py:501, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Command to send: m d o2811 e (clientserver.py:501, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Command to send: m d o2812 e (clientserver.py:501, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Command to send: m d o2813 e (clientserver.py:501, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /broken2 HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:39 [ 600 ] DEBUG : Executing query INSERT INTO TABLE FUNCTION file('test_restart_broken_table_functionaWgvbMXO3N.parquet') SETTINGS output_format_parquet_compression_method='none', s3_truncate_on_insert=1 SELECT number, toString(number) FROM numbers(100) FORMAT Parquet on node1 (cluster.py:3564, query) 2025-04-02 03:06:39 [ 600 ] DEBUG : Command to send: c o55 read e (clientserver.py:501, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Answer received: !yro2814 (clientserver.py:512, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Command to send: c o2814 load s/ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/database/user_files/test_restart_broken_table_functionaWgvbMXO3N.parquet e (clientserver.py:501, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Answer received: !yro2815 (clientserver.py:512, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Command to send: c o2815 write e (clientserver.py:501, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Answer received: !yro2816 (clientserver.py:512, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Command to send: c o2816 mode soverwrite e (clientserver.py:501, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Answer received: !yro2817 (clientserver.py:512, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Command to send: c o2817 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Answer received: !yro2818 (clientserver.py:512, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Command to send: c o2818 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Answer received: !yro2819 (clientserver.py:512, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Command to send: c o2819 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Answer received: !yro2820 (clientserver.py:512, send_command) 2025-04-02 03:06:39 [ 600 ] DEBUG : Command to send: c o2820 save s/test_restart_broken_table_functionaWgvbMXO3N e (clientserver.py:501, send_command) 2025-04-02 03:06:42 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:42 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /broken2//test_restart_broken_table_functionaWgvbMXO3N/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:42 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /broken2//test_restart_broken_table_functionaWgvbMXO3N/part-00000-999071a7-e507-436d-9c36-220a441f7b01-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:42 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_restart_broken_table_functionaWgvbMXO3N; CREATE TABLE test_restart_broken_table_functionaWgvbMXO3N AS deltaLake(s3, filename = 'test_restart_broken_table_functionaWgvbMXO3N/', url = 'http://minio1:9001/broken2/') on node1 (cluster.py:3564, query) ____________________ test_restart_broken_table_function[1] _____________________ started_cluster = use_delta_kernel = '1' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_restart_broken_table_function(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client bucket = "broken2" TABLE_NAME = randomize_table_name("test_restart_broken_table_function") if not minio_client.bucket_exists(bucket): minio_client.make_bucket(bucket) parquet_data_path = create_initial_data_file( started_cluster, instance, "SELECT number, toString(number) FROM numbers(100)", TABLE_NAME, ) write_delta_from_file(spark, parquet_data_path, f"/{TABLE_NAME}") upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") > instance.query( f""" DROP TABLE IF EXISTS {TABLE_NAME}; CREATE TABLE {TABLE_NAME} AS deltaLake(s3, filename = '{TABLE_NAME}/', url = 'http://minio1:9001/{bucket}/')""" ) test_storage_delta/test.py:536: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 46, stderr: Received exception from server (version 25.2.2): E Code: 46. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table function deltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/TableFunctions/TableFunctionFactory.cpp:50: DB::TableFunctionFactory::get(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002599a46c E 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:972: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&, DB::LoadingStrictnessLevel) const @ 0x00000000296c3ade E 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1658: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000296d6064 E 7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:2331: DB::InterpreterCreateQuery::execute() @ 0x00000000296f1d98 E 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1458: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a01ae63 E 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 10. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 11. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 13. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 15. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 16. asan_thread_start(void*) @ 0x000000000b6a3e77 E 17. ? @ 0x00007fa1c9941ac3 E 18. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_FUNCTION) E (query: CREATE TABLE test_restart_broken_table_functionlAS61Oehm7 E AS deltaLake(s3, filename = 'test_restart_broken_table_functionlAS61Oehm7/', url = 'http://minio1:9001/broken2/')) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:06:42 [ 600 ] DEBUG : http://172.16.1.8:9001 "HEAD /broken2 HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:42 [ 600 ] DEBUG : Executing query INSERT INTO TABLE FUNCTION file('test_restart_broken_table_functionlAS61Oehm7.parquet') SETTINGS output_format_parquet_compression_method='none', s3_truncate_on_insert=1 SELECT number, toString(number) FROM numbers(100) FORMAT Parquet on node1 (cluster.py:3564, query) 2025-04-02 03:06:43 [ 600 ] DEBUG : Command to send: c o55 read e (clientserver.py:501, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Answer received: !yro2821 (clientserver.py:512, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Command to send: c o2821 load s/ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/database/user_files/test_restart_broken_table_functionlAS61Oehm7.parquet e (clientserver.py:501, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Command to send: m d o2814 e (clientserver.py:501, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Command to send: m d o2815 e (clientserver.py:501, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Command to send: m d o2816 e (clientserver.py:501, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Command to send: m d o2817 e (clientserver.py:501, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Command to send: m d o2818 e (clientserver.py:501, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Command to send: m d o2819 e (clientserver.py:501, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Command to send: m d o2820 e (clientserver.py:501, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Answer received: !yro2822 (clientserver.py:512, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Command to send: c o2822 write e (clientserver.py:501, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Answer received: !yro2823 (clientserver.py:512, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Command to send: c o2823 mode soverwrite e (clientserver.py:501, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Answer received: !yro2824 (clientserver.py:512, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Command to send: c o2824 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Answer received: !yro2825 (clientserver.py:512, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Command to send: c o2825 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Answer received: !yro2826 (clientserver.py:512, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Command to send: c o2826 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Answer received: !yro2827 (clientserver.py:512, send_command) 2025-04-02 03:06:43 [ 600 ] DEBUG : Command to send: c o2827 save s/test_restart_broken_table_functionlAS61Oehm7 e (clientserver.py:501, send_command) 2025-04-02 03:06:45 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:45 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /broken2//test_restart_broken_table_functionlAS61Oehm7/part-00000-92e1a890-3a80-4213-a688-6d15bb6666cc-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:45 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /broken2//test_restart_broken_table_functionlAS61Oehm7/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:45 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_restart_broken_table_functionlAS61Oehm7; CREATE TABLE test_restart_broken_table_functionlAS61Oehm7 AS deltaLake(s3, filename = 'test_restart_broken_table_functionlAS61Oehm7/', url = 'http://minio1:9001/broken2/') on node1 (cluster.py:3564, query) ___________________________ test_single_log_file[0] ____________________________ started_cluster = use_delta_kernel = '0' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_single_log_file(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket TABLE_NAME = randomize_table_name("test_single_log_file") inserted_data = "SELECT number as a, toString(number + 1) as b FROM numbers(100)" parquet_data_path = create_initial_data_file( started_cluster, instance, inserted_data, TABLE_NAME ) write_delta_from_file(spark, parquet_data_path, f"/{TABLE_NAME}") files = upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") assert len(files) == 2 # 1 metadata files + 1 data file > create_delta_table(instance, TABLE_NAME, use_delta_kernel=use_delta_kernel) test_storage_delta/test.py:197: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_delta/test.py:152: in create_delta_table node.query( helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 56, stderr: Received exception from server (version 25.2.2): E Code: 56. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table engine DeltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Storages/StorageFactory.cpp:276: DB::StorageFactory::getStorageFeatures(String const&) const @ 0x000000002d62e3cc E 5. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:105: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr const&, std::shared_ptr) @ 0x000000002995251c E 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1124: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a015adc E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 8. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 9. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 11. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 13. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 14. asan_thread_start(void*) @ 0x000000000b6a3e77 E 15. ? @ 0x00007fa1c9941ac3 E 16. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_STORAGE) E (query: CREATE TABLE test_single_log_filek1NAvxiCt5 E ENGINE=DeltaLake(s3, filename = 'test_single_log_filek1NAvxiCt5/', url = 'http://minio1:9001/root/') E SETTINGS allow_experimental_delta_kernel_rs=0) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:06:46 [ 600 ] DEBUG : Executing query INSERT INTO TABLE FUNCTION file('test_single_log_filek1NAvxiCt5.parquet') SETTINGS output_format_parquet_compression_method='none', s3_truncate_on_insert=1 SELECT number as a, toString(number + 1) as b FROM numbers(100) FORMAT Parquet on node1 (cluster.py:3564, query) 2025-04-02 03:06:46 [ 600 ] DEBUG : Command to send: c o55 read e (clientserver.py:501, send_command) 2025-04-02 03:06:46 [ 600 ] DEBUG : Answer received: !yro2828 (clientserver.py:512, send_command) 2025-04-02 03:06:46 [ 600 ] DEBUG : Command to send: c o2828 load s/ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/database/user_files/test_single_log_filek1NAvxiCt5.parquet e (clientserver.py:501, send_command) 2025-04-02 03:06:46 [ 600 ] DEBUG : Answer received: !yro2829 (clientserver.py:512, send_command) 2025-04-02 03:06:46 [ 600 ] DEBUG : Command to send: c o2829 write e (clientserver.py:501, send_command) 2025-04-02 03:06:46 [ 600 ] DEBUG : Answer received: !yro2830 (clientserver.py:512, send_command) 2025-04-02 03:06:46 [ 600 ] DEBUG : Command to send: c o2830 mode soverwrite e (clientserver.py:501, send_command) 2025-04-02 03:06:46 [ 600 ] DEBUG : Answer received: !yro2831 (clientserver.py:512, send_command) 2025-04-02 03:06:46 [ 600 ] DEBUG : Command to send: c o2831 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:06:46 [ 600 ] DEBUG : Answer received: !yro2832 (clientserver.py:512, send_command) 2025-04-02 03:06:46 [ 600 ] DEBUG : Command to send: c o2832 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:06:46 [ 600 ] DEBUG : Answer received: !yro2833 (clientserver.py:512, send_command) 2025-04-02 03:06:46 [ 600 ] DEBUG : Command to send: c o2833 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:06:46 [ 600 ] DEBUG : Answer received: !yro2834 (clientserver.py:512, send_command) 2025-04-02 03:06:46 [ 600 ] DEBUG : Command to send: c o2834 save s/test_single_log_filek1NAvxiCt5 e (clientserver.py:501, send_command) 2025-04-02 03:06:47 [ 600 ] DEBUG : Command to send: m d o2821 e (clientserver.py:501, send_command) 2025-04-02 03:06:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:47 [ 600 ] DEBUG : Command to send: m d o2822 e (clientserver.py:501, send_command) 2025-04-02 03:06:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:47 [ 600 ] DEBUG : Command to send: m d o2823 e (clientserver.py:501, send_command) 2025-04-02 03:06:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:47 [ 600 ] DEBUG : Command to send: m d o2824 e (clientserver.py:501, send_command) 2025-04-02 03:06:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:47 [ 600 ] DEBUG : Command to send: m d o2825 e (clientserver.py:501, send_command) 2025-04-02 03:06:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:47 [ 600 ] DEBUG : Command to send: m d o2826 e (clientserver.py:501, send_command) 2025-04-02 03:06:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:47 [ 600 ] DEBUG : Command to send: m d o2827 e (clientserver.py:501, send_command) 2025-04-02 03:06:47 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:49 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:49 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_single_log_filek1NAvxiCt5/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:49 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_single_log_filek1NAvxiCt5/part-00000-df2cd425-7761-4458-8eab-9ab47ecf9ba6-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:49 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_single_log_filek1NAvxiCt5; CREATE TABLE test_single_log_filek1NAvxiCt5 ENGINE=DeltaLake(s3, filename = 'test_single_log_filek1NAvxiCt5/', url = 'http://minio1:9001/root/') SETTINGS allow_experimental_delta_kernel_rs=0 on node1 (cluster.py:3564, query) ___________________________ test_single_log_file[1] ____________________________ started_cluster = use_delta_kernel = '1' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_single_log_file(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] spark = started_cluster.spark_session minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket TABLE_NAME = randomize_table_name("test_single_log_file") inserted_data = "SELECT number as a, toString(number + 1) as b FROM numbers(100)" parquet_data_path = create_initial_data_file( started_cluster, instance, inserted_data, TABLE_NAME ) write_delta_from_file(spark, parquet_data_path, f"/{TABLE_NAME}") files = upload_directory(minio_client, bucket, f"/{TABLE_NAME}", "") assert len(files) == 2 # 1 metadata files + 1 data file > create_delta_table(instance, TABLE_NAME, use_delta_kernel=use_delta_kernel) test_storage_delta/test.py:197: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_storage_delta/test.py:152: in create_delta_table node.query( helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 56, stderr: Received exception from server (version 25.2.2): E Code: 56. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table engine DeltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Storages/StorageFactory.cpp:276: DB::StorageFactory::getStorageFeatures(String const&) const @ 0x000000002d62e3cc E 5. ./build_docker/./src/Interpreters/InterpreterSetQuery.cpp:105: DB::InterpreterSetQuery::applySettingsFromQuery(std::shared_ptr const&, std::shared_ptr) @ 0x000000002995251c E 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1124: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a015adc E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 8. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 9. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 11. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 13. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 14. asan_thread_start(void*) @ 0x000000000b6a3e77 E 15. ? @ 0x00007fa1c9941ac3 E 16. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_STORAGE) E (query: CREATE TABLE test_single_log_fileDd56ydOjyi E ENGINE=DeltaLake(s3, filename = 'test_single_log_fileDd56ydOjyi/', url = 'http://minio1:9001/root/') E SETTINGS allow_experimental_delta_kernel_rs=1) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:06:49 [ 600 ] DEBUG : Executing query INSERT INTO TABLE FUNCTION file('test_single_log_fileDd56ydOjyi.parquet') SETTINGS output_format_parquet_compression_method='none', s3_truncate_on_insert=1 SELECT number as a, toString(number + 1) as b FROM numbers(100) FORMAT Parquet on node1 (cluster.py:3564, query) 2025-04-02 03:06:50 [ 600 ] DEBUG : Command to send: m d o2828 e (clientserver.py:501, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Command to send: m d o2829 e (clientserver.py:501, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Command to send: m d o2830 e (clientserver.py:501, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Command to send: m d o2831 e (clientserver.py:501, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Command to send: m d o2832 e (clientserver.py:501, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Command to send: m d o2833 e (clientserver.py:501, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Command to send: m d o2834 e (clientserver.py:501, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Command to send: c o55 read e (clientserver.py:501, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Answer received: !yro2835 (clientserver.py:512, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Command to send: c o2835 load s/ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/database/user_files/test_single_log_fileDd56ydOjyi.parquet e (clientserver.py:501, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Answer received: !yro2836 (clientserver.py:512, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Command to send: c o2836 write e (clientserver.py:501, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Answer received: !yro2837 (clientserver.py:512, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Command to send: c o2837 mode soverwrite e (clientserver.py:501, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Answer received: !yro2838 (clientserver.py:512, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Command to send: c o2838 option scompression snone e (clientserver.py:501, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Answer received: !yro2839 (clientserver.py:512, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Command to send: c o2839 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Answer received: !yro2840 (clientserver.py:512, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Command to send: c o2840 option sdelta.columnMapping.mode sname e (clientserver.py:501, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Answer received: !yro2841 (clientserver.py:512, send_command) 2025-04-02 03:06:50 [ 600 ] DEBUG : Command to send: c o2841 save s/test_single_log_fileDd56ydOjyi e (clientserver.py:501, send_command) 2025-04-02 03:06:52 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:52 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_single_log_fileDd56ydOjyi/part-00000-a3de4b6e-c59c-44ce-8849-b2102ae9bec8-c000.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:52 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_single_log_fileDd56ydOjyi/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:52 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_single_log_fileDd56ydOjyi; CREATE TABLE test_single_log_fileDd56ydOjyi ENGINE=DeltaLake(s3, filename = 'test_single_log_fileDd56ydOjyi/', url = 'http://minio1:9001/root/') SETTINGS allow_experimental_delta_kernel_rs=1 on node1 (cluster.py:3564, query) ________________________________ test_types[0] _________________________________ started_cluster = use_delta_kernel = '0' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_types(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] TABLE_NAME = randomize_table_name("test_types") spark = started_cluster.spark_session result_file = randomize_table_name(f"{TABLE_NAME}_result_2") delta_table = ( DeltaTable.create(spark) .tableName(TABLE_NAME) .location(f"/{result_file}") .addColumn("a", "INT", nullable=True) .addColumn("b", "STRING", nullable=False) .addColumn("c", "DATE", nullable=False) .addColumn("d", "ARRAY", nullable=False) .addColumn("e", "BOOLEAN", nullable=True) .addColumn("f", ArrayType(StringType(), containsNull=False), nullable=False) .execute() ) data = [ ( 123, "string", datetime.strptime("2000-01-01", "%Y-%m-%d"), ["str1", "str2"], True, ["str1", "str4"], ) ] schema = StructType( [ StructField("a", IntegerType(), nullable=True), StructField("b", StringType(), nullable=False), StructField("c", DateType(), nullable=False), StructField("d", ArrayType(StringType())), StructField("e", BooleanType(), nullable=False), StructField("f", ArrayType(StringType(), containsNull=False)), ] ) df = spark.createDataFrame(data=data, schema=schema) df.printSchema() df.write.mode("append").format("delta").saveAsTable(TABLE_NAME) minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket upload_directory(minio_client, bucket, f"/{result_file}", "") > instance.query( f""" DROP TABLE IF EXISTS {TABLE_NAME}; CREATE TABLE {TABLE_NAME} ENGINE=DeltaLake('http://{started_cluster.minio_ip}:{started_cluster.minio_port}/{bucket}/{result_file}/', 'minio', 'minio123')""" ) test_storage_delta/test.py:425: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 56, stderr: Received exception from server (version 25.2.2): E Code: 56. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table engine DeltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Storages/StorageFactory.cpp:276: DB::StorageFactory::getStorageFeatures(String const&) const @ 0x000000002d62e3cc E 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:991: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&, DB::LoadingStrictnessLevel) const @ 0x00000000296c6e76 E 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1658: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000296d6064 E 7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:2331: DB::InterpreterCreateQuery::execute() @ 0x00000000296f1d98 E 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1458: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a01ae63 E 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 10. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 11. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 13. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 15. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 16. asan_thread_start(void*) @ 0x000000000b6a3e77 E 17. ? @ 0x00007fa1c9941ac3 E 18. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_STORAGE) E (query: CREATE TABLE test_typesvqlUMZ9iOu ENGINE=DeltaLake('http://172.16.1.8:9001/root/test_typesvqlUMZ9iOu_result_2TJuMqM4FU0/', 'minio', 'minio123')) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable create e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable create ro55 e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2842 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2842 tableName stest_typesvqlUMZ9iOu e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2843 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2843 location s/test_typesvqlUMZ9iOu_result_2TJuMqM4FU0 e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2844 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sa e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2845 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2845 dataType sINT e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2846 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2846 nullable bTrue e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2847 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2847 build e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2848 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2844 addColumn ro2848 e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2849 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sb e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2850 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2850 dataType sSTRING e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2851 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2851 nullable bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2852 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2852 build e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2853 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2849 addColumn ro2853 e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2854 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sc e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2855 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2855 dataType sDATE e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2856 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2856 nullable bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2857 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2857 build e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2858 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2854 addColumn ro2858 e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2859 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sd e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2860 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2860 dataType sARRAY e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2861 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2861 nullable bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2862 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2862 build e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2863 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2859 addColumn ro2863 e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2864 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 se e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2865 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2865 dataType sBOOLEAN e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2866 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2866 nullable bTrue e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2867 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2867 build e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2868 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2864 addColumn ro2868 e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2869 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sf e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2870 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o55 parseDataType s{"containsNull":false,"elementType":"string","type":"array"} e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2871 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2870 dataType ro2871 e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2872 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2872 nullable bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2873 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2873 build e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2874 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2869 addColumn ro2874 e (clientserver.py:501, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Answer received: !yro2875 (clientserver.py:512, send_command) 2025-04-02 03:06:53 [ 600 ] DEBUG : Command to send: c o2875 execute e (clientserver.py:501, send_command) 2025-04-02 03:06:54 [ 600 ] DEBUG : Command to send: m d o2835 e (clientserver.py:501, send_command) 2025-04-02 03:06:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:54 [ 600 ] DEBUG : Command to send: m d o2836 e (clientserver.py:501, send_command) 2025-04-02 03:06:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:54 [ 600 ] DEBUG : Command to send: m d o2837 e (clientserver.py:501, send_command) 2025-04-02 03:06:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:54 [ 600 ] DEBUG : Command to send: m d o2838 e (clientserver.py:501, send_command) 2025-04-02 03:06:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:54 [ 600 ] DEBUG : Command to send: m d o2839 e (clientserver.py:501, send_command) 2025-04-02 03:06:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:54 [ 600 ] DEBUG : Command to send: m d o2840 e (clientserver.py:501, send_command) 2025-04-02 03:06:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:54 [ 600 ] DEBUG : Command to send: m d o2841 e (clientserver.py:501, send_command) 2025-04-02 03:06:54 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yro2876 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yro2877 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c o2877 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmpi9ygjh9c i1 e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yro2878 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c o2878 id e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yi2852 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c o2878 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yro2879 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c o2879 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yao2880 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c o2880 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !ylo2881 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !ylo2882 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2880 ro2881 spython3 s3.10 ro2882 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yro2883 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c o2878 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yro2884 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2884 ro2883 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yro2885 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c o2885 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yro2886 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2886 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yro2887 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2887 e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yro2888 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c o2888 rdd e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yro2889 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2889 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":false,"type":"string"},{"metadata":{},"name":"c","nullable":false,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":{"containsNull":true,"elementType":"string","type":"array"}},{"metadata":{},"name":"e","nullable":false,"type":"boolean"},{"metadata":{},"name":"f","nullable":true,"type":{"containsNull":false,"elementType":"string","type":"array"}}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yro2890 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c o2890 schema e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yro2891 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c o2891 treeString e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = false)\n |-- c: date (nullable = false)\n |-- d: array (nullable = true)\n | |-- element: string (containsNull = true)\n |-- e: boolean (nullable = false)\n |-- f: array (nullable = true)\n | |-- element: string (containsNull = false)\n (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c o2890 write e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yro2892 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c o2892 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yro2893 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c o2893 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Answer received: !yro2894 (clientserver.py:512, send_command) 2025-04-02 03:06:55 [ 600 ] DEBUG : Command to send: c o2894 saveAsTable stest_typesvqlUMZ9iOu e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2842 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2843 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2844 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2845 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2846 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2847 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2848 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2849 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2850 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2851 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2852 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2853 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2854 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2855 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2856 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2857 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2858 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2859 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2860 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2861 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2862 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2863 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2864 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2865 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2866 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2867 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2868 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2869 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2870 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2871 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2872 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2873 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2874 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2875 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2880 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2881 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Command to send: m d o2882 e (clientserver.py:501, send_command) 2025-04-02 03:06:56 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_typesvqlUMZ9iOu_result_2TJuMqM4FU0/part-00000-543f2631-91de-43a3-b592-19718eb02ddb-c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:58 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_typesvqlUMZ9iOu_result_2TJuMqM4FU0/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:58 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_typesvqlUMZ9iOu_result_2TJuMqM4FU0/_delta_log/00000000000000000001.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:06:58 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_typesvqlUMZ9iOu; CREATE TABLE test_typesvqlUMZ9iOu ENGINE=DeltaLake('http://172.16.1.8:9001/root/test_typesvqlUMZ9iOu_result_2TJuMqM4FU0/', 'minio', 'minio123') on node1 (cluster.py:3564, query) ________________________________ test_types[1] _________________________________ started_cluster = use_delta_kernel = '1' @pytest.mark.parametrize("use_delta_kernel", ["1", "0"]) def test_types(started_cluster, use_delta_kernel): instance = started_cluster.instances["node1"] TABLE_NAME = randomize_table_name("test_types") spark = started_cluster.spark_session result_file = randomize_table_name(f"{TABLE_NAME}_result_2") delta_table = ( DeltaTable.create(spark) .tableName(TABLE_NAME) .location(f"/{result_file}") .addColumn("a", "INT", nullable=True) .addColumn("b", "STRING", nullable=False) .addColumn("c", "DATE", nullable=False) .addColumn("d", "ARRAY", nullable=False) .addColumn("e", "BOOLEAN", nullable=True) .addColumn("f", ArrayType(StringType(), containsNull=False), nullable=False) .execute() ) data = [ ( 123, "string", datetime.strptime("2000-01-01", "%Y-%m-%d"), ["str1", "str2"], True, ["str1", "str4"], ) ] schema = StructType( [ StructField("a", IntegerType(), nullable=True), StructField("b", StringType(), nullable=False), StructField("c", DateType(), nullable=False), StructField("d", ArrayType(StringType())), StructField("e", BooleanType(), nullable=False), StructField("f", ArrayType(StringType(), containsNull=False)), ] ) df = spark.createDataFrame(data=data, schema=schema) df.printSchema() df.write.mode("append").format("delta").saveAsTable(TABLE_NAME) minio_client = started_cluster.minio_client bucket = started_cluster.minio_bucket upload_directory(minio_client, bucket, f"/{result_file}", "") > instance.query( f""" DROP TABLE IF EXISTS {TABLE_NAME}; CREATE TABLE {TABLE_NAME} ENGINE=DeltaLake('http://{started_cluster.minio_ip}:{started_cluster.minio_port}/{bucket}/{result_file}/', 'minio', 'minio123')""" ) test_storage_delta/test.py:425: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3565: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 56, stderr: Received exception from server (version 25.2.2): E Code: 56. DB::Exception: Received from 172.16.1.9:9000. DB::Exception: Unknown table engine DeltaLake. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x0000000036e1abd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001b02b0f1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b6f264b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000d06ad98 E 4. ./build_docker/./src/Storages/StorageFactory.cpp:276: DB::StorageFactory::getStorageFeatures(String const&) const @ 0x000000002d62e3cc E 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:991: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&, DB::LoadingStrictnessLevel) const @ 0x00000000296c6e76 E 6. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1658: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x00000000296d6064 E 7. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:2331: DB::InterpreterCreateQuery::execute() @ 0x00000000296f1d98 E 8. ./build_docker/./src/Interpreters/executeQuery.cpp:1458: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002a01ae63 E 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1625: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002a012d85 E 10. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x000000002f1a25d6 E 11. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x000000002f1e22da E 12. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000036ff5ecf E 13. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000036ff6b97 E 14. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000036f054ef E 15. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000036eff0e8 E 16. asan_thread_start(void*) @ 0x000000000b6a3e77 E 17. ? @ 0x00007fa1c9941ac3 E 18. ? @ 0x00007fa1c99d3850 E . (UNKNOWN_STORAGE) E (query: CREATE TABLE test_typesYUGO2ca56b ENGINE=DeltaLake('http://172.16.1.8:9001/root/test_typesYUGO2ca56b_result_2Ke69XOU5Dz/', 'minio', 'minio123')) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable create e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable create ro55 e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2895 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2895 tableName stest_typesYUGO2ca56b e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2896 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2896 location s/test_typesYUGO2ca56b_result_2Ke69XOU5Dz e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2897 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sa e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2898 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2898 dataType sINT e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2899 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2899 nullable bTrue e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2900 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2900 build e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2901 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2897 addColumn ro2901 e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2902 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sb e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2903 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2903 dataType sSTRING e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2904 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2904 nullable bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2905 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2905 build e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2906 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2902 addColumn ro2906 e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2907 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sc e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2908 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2908 dataType sDATE e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2909 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2909 nullable bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2910 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2910 build e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2911 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2907 addColumn ro2911 e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2912 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sd e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2913 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2913 dataType sARRAY e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2914 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2914 nullable bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2915 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2915 build e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2916 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2912 addColumn ro2916 e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2917 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 se e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2918 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2918 dataType sBOOLEAN e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2919 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2919 nullable bTrue e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2920 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2920 build e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2921 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: c o2917 addColumn ro2921 e (clientserver.py:501, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Answer received: !yro2922 (clientserver.py:512, send_command) 2025-04-02 03:06:58 [ 600 ] DEBUG : Command to send: r u io rj e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: r u io.delta rj e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: r u io.delta.tables rj e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: r u io.delta.tables.DeltaTable rj e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !ycio.delta.tables.DeltaTable (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: r m io.delta.tables.DeltaTable columnBuilder e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: c z:io.delta.tables.DeltaTable columnBuilder ro55 sf e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yro2923 (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: c o55 parseDataType s{"containsNull":false,"elementType":"string","type":"array"} e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yro2924 (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: c o2923 dataType ro2924 e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yro2925 (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: c o2925 nullable bFalse e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yro2926 (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: c o2926 build e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yro2927 (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: c o2922 addColumn ro2927 e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yro2928 (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: c o2928 execute e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: m d o2877 e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: m d o2878 e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: m d o2879 e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: m d o2883 e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: m d o2884 e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: m d o2885 e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: m d o2886 e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: m d o2887 e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: m d o2888 e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: m d o2889 e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: m d o2891 e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: m d o2892 e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: m d o2893 e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Command to send: m d o2894 e (clientserver.py:501, send_command) 2025-04-02 03:06:59 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yro2929 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro55 e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c o44 sc e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yro2930 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c o2930 defaultParallelism e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yi1 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonRDD readRDDFromFile e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonRDD readRDDFromFile ro44 s/tmp/spark-4e222d6f-661e-49a7-8448-b2d2e509ab84/pyspark-fbc0d5b8-2531-482d-bf0d-e55fc01d0160/tmph_w_0_13 i1 e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yro2931 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c o2931 id e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yi2904 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil toJavaArray e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c o2931 rdd e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yro2932 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c o2932 isBarrier e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: r u SerDeUtil rj e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.SerDeUtil (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.SerDeUtil pythonToJava e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getBroadcastThreshold e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getBroadcastThreshold ro44 e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yL1048576 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: r u PythonFunction rj e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonFunction (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yao2933 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c o2933 put sPYTHONHASHSEED s0 e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !ylo2934 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: i java.util.ArrayList e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !ylo2935 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonFunction jgAWVrwQAAAAAAAAojB9weXNwYXJrLmNsb3VkcGlja2xlLmNsb3VkcGlja2xllIwNX2J1aWx0aW5fdHlwZZSTlIwKTGFtYmRhVHlwZZSFlFKUKGgCjAhDb2RlVHlwZZSFlFKUKEsCSwBLAEsCSwNLE0MOdAB0AYgAgwF8AYMCUwCUToWUjANtYXCUjBVmYWlsX29uX3N0b3BpdGVyYXRpb26UhpSMAV+UjAhpdGVyYXRvcpSGlIw2L3Vzci9sb2NhbC9saWIvcHl0aG9uMy4xMC9kaXN0LXBhY2thZ2VzL3B5c3BhcmsvcmRkLnB5lIwEZnVuY5RN8wFDAg4BlIwBZpSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMB3B5c3BhcmuUjAhfX25hbWVfX5SMC3B5c3BhcmsucmRklIwIX19maWxlX1+UjDYvdXNyL2xvY2FsL2xpYi9weXRob24zLjEwL2Rpc3QtcGFja2FnZXMvcHlzcGFyay9yZGQucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpSMJHB5c3BhcmsuY2xvdWRwaWNrbGUuY2xvdWRwaWNrbGVfZmFzdJSMEl9mdW5jdGlvbl9zZXRzdGF0ZZSTlGgkfZR9lChoG2gSjAxfX3F1YWxuYW1lX1+UjBVSREQubWFwLjxsb2NhbHM+LmZ1bmOUjA9fX2Fubm90YXRpb25zX1+UfZQoaA6MCGJ1aWx0aW5zlIwDaW50lJOUaA+MCV9vcGVyYXRvcpSMB2dldGl0ZW2Uk5SMBnR5cGluZ5SMCEl0ZXJhYmxllJOUjAhidWlsdGluc5SMB2dldGF0dHKUk5RoAIwJc3ViaW1wb3J0lJOUaByFlFKUjAFUlIaUUpSGlFKUjAZyZXR1cm6UaDNoNmg5aD2MAVWUhpRSlIaUUpR1jA5fX2t3ZGVmYXVsdHNfX5ROjAxfX2RlZmF1bHRzX1+UTowKX19tb2R1bGVfX5RoHIwHX19kb2NfX5ROjAtfX2Nsb3N1cmVfX5RoAIwKX21ha2VfY2VsbJSTlGgFKGgIKEsBSwBLAEsBSwFLU0MEfABTAJRoCimMAXiUhZRoEYwIPGxhbWJkYT6UTVEDQwIEAJQpKXSUUpRoGE5OTnSUUpRoJ2hYfZR9lChoG2hTaCqMIlJERC5fcmVzZXJpYWxpemUuPGxvY2Fscz4uPGxhbWJkYT6UaCx9lGhJTmhKTmhLaBxoTE5oTU6MF19jbG91ZHBpY2tsZV9zdWJtb2R1bGVzlF2UjAtfX2dsb2JhbHNfX5R9lHWGlIZSMIWUUpSFlGhdXZRoX32UaAyMDHB5c3BhcmsudXRpbJRoDJOUc3WGlIZSME6ME3B5c3Bhcmsuc2VyaWFsaXplcnOUjBFCYXRjaGVkU2VyaWFsaXplcpSTlCmBlH2UKIwKc2VyaWFsaXplcpRoaowVQ2xvdWRQaWNrbGVTZXJpYWxpemVylJOUKYGUjAliYXRjaFNpemWUSwF1YmhqjBVBdXRvQmF0Y2hlZFNlcmlhbGl6ZXKUk5QpgZR9lChob2hxKYGUaHNLAIwIYmVzdFNpemWUSgAAAQB1YnSULg== ro2933 ro2934 spython3 s3.10 ro2935 ro47 e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yro2936 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: r u PythonRDD rj e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonRDD (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c o2931 rdd e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yro2937 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonRDD ro2937 ro2936 bTrue bFalse e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yro2938 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c o2938 asJavaRDD e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yro2939 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil pythonToJava ro2939 bTrue e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yro2940 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c z:org.apache.spark.api.python.SerDeUtil toJavaArray ro2940 e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yro2941 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c o2941 rdd e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yro2942 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c o55 applySchemaToPythonRDD ro2942 s{"fields":[{"metadata":{},"name":"a","nullable":true,"type":"integer"},{"metadata":{},"name":"b","nullable":false,"type":"string"},{"metadata":{},"name":"c","nullable":false,"type":"date"},{"metadata":{},"name":"d","nullable":true,"type":{"containsNull":true,"elementType":"string","type":"array"}},{"metadata":{},"name":"e","nullable":false,"type":"boolean"},{"metadata":{},"name":"f","nullable":true,"type":{"containsNull":false,"elementType":"string","type":"array"}}],"type":"struct"} e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yro2943 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c o2943 schema e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yro2944 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c o2944 treeString e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !ysroot\n |-- a: integer (nullable = true)\n |-- b: string (nullable = false)\n |-- c: date (nullable = false)\n |-- d: array (nullable = true)\n | |-- element: string (containsNull = true)\n |-- e: boolean (nullable = false)\n |-- f: array (nullable = true)\n | |-- element: string (containsNull = false)\n (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c o2943 write e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yro2945 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c o2945 mode sappend e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yro2946 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c o2946 format sdelta e (clientserver.py:501, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Answer received: !yro2947 (clientserver.py:512, send_command) 2025-04-02 03:07:01 [ 600 ] DEBUG : Command to send: c o2947 saveAsTable stest_typesYUGO2ca56b e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2895 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2896 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2897 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2898 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2899 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2900 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2901 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2902 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2903 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2904 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2905 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2906 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2907 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2908 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2909 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2910 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2911 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2912 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2913 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2914 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2915 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2916 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2917 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2918 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2919 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2920 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2921 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2922 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2923 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2924 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2925 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2926 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2927 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2928 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2933 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2934 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Command to send: m d o2935 e (clientserver.py:501, send_command) 2025-04-02 03:07:02 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:04 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:04 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_typesYUGO2ca56b_result_2Ke69XOU5Dz/_delta_log/00000000000000000000.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:07:04 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_typesYUGO2ca56b_result_2Ke69XOU5Dz/_delta_log/00000000000000000001.json HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:07:04 [ 600 ] DEBUG : http://172.16.1.8:9001 "PUT /root//test_typesYUGO2ca56b_result_2Ke69XOU5Dz/part-00000-b54a6b35-1e2f-412e-979f-b336501289b4-c000.snappy.parquet HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-02 03:07:04 [ 600 ] DEBUG : Executing query DROP TABLE IF EXISTS test_typesYUGO2ca56b; CREATE TABLE test_typesYUGO2ca56b ENGINE=DeltaLake('http://172.16.1.8:9001/root/test_typesYUGO2ca56b_result_2Ke69XOU5Dz/', 'minio', 'minio123') on node1 (cluster.py:3564, query) ---------------------------- Captured log teardown ----------------------------- 2025-04-02 03:07:04 [ 600 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_storage_delta/_instances-1/.env --project-name rootteststoragedelta --file /ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_storage_delta/_instances-1/node2/docker-compose.yml stop --timeout 20] (cluster.py:120, run_and_check) 2025-04-02 03:07:05 [ 600 ] DEBUG : Command to send: m d o2930 e (clientserver.py:501, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Command to send: m d o2931 e (clientserver.py:501, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Command to send: m d o2932 e (clientserver.py:501, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Command to send: m d o2936 e (clientserver.py:501, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Command to send: m d o2937 e (clientserver.py:501, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Command to send: m d o2938 e (clientserver.py:501, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Command to send: m d o2939 e (clientserver.py:501, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Command to send: m d o2940 e (clientserver.py:501, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Command to send: m d o2941 e (clientserver.py:501, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Command to send: m d o2942 e (clientserver.py:501, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Command to send: m d o2944 e (clientserver.py:501, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Command to send: m d o2945 e (clientserver.py:501, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Command to send: m d o2946 e (clientserver.py:501, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Command to send: m d o2947 e (clientserver.py:501, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Command to send: m d o2890 e (clientserver.py:501, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Command to send: m d o2876 e (clientserver.py:501, send_command) 2025-04-02 03:07:05 [ 600 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node2-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-resolver-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node1-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node2-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node1-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-minio1-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo2-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo1-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo3-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-minio1-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo1-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo3-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo2-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-resolver-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy2-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy1-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy1-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy2-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:120, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_storage_delta/_instances-1/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_storage_delta/_instances-1/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:120, run_and_check) 2025-04-02 03:07:25 [ 600 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_storage_delta/_instances-1/.env --project-name rootteststoragedelta --file /ClickHouse/tests/integration/test_storage_delta/_instances-1/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --file /ClickHouse/tests/integration/test_storage_delta/_instances-1/node2/docker-compose.yml down --volumes] (cluster.py:120, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node1-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node2-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-resolver-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node1-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node1-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node2-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node2-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-resolver-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-resolver-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-resolver-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node1-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-node2-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo2-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-minio1-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo3-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo1-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo3-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo3-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo1-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo1-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo2-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo2-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-minio1-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-minio1-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo3-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo2-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-zoo1-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-minio1-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy2-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy1-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy2-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy2-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy1-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy1-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy2-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Container rootteststoragedelta-proxy1-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Volume rootteststoragedelta_data1-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Network rootteststoragedelta_default Removing (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Volume rootteststoragedelta_data1-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stderr: Network rootteststoragedelta_default Removed (cluster.py:146, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2025-04-02 03:07:26 [ 600 ] DEBUG : Docker networks for project rootteststoragedelta are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2025-04-02 03:07:26 [ 600 ] DEBUG : Docker containers for project rootteststoragedelta are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2025-04-02 03:07:26 [ 600 ] DEBUG : Docker volumes for project rootteststoragedelta are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2025-04-02 03:07:26 [ 600 ] DEBUG : Command:[docker container list --all --filter name='^/rootteststoragedelta-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:120, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2025-04-02 03:07:26 [ 600 ] DEBUG : No running containers for project: rootteststoragedelta (cluster.py:904, cleanup) 2025-04-02 03:07:26 [ 600 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2025-04-02 03:07:26 [ 600 ] DEBUG : Trying to prune unused images... (cluster.py:926, cleanup) 2025-04-02 03:07:26 [ 600 ] DEBUG : Command:[docker image prune -f] (cluster.py:120, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:144, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Images pruned (cluster.py:929, cleanup) 2025-04-02 03:07:26 [ 600 ] DEBUG : Trying to prune unused volumes... (cluster.py:935, cleanup) 2025-04-02 03:07:26 [ 600 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:120, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stdout:1 (cluster.py:144, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Volumes pruned: 1 (cluster.py:940, cleanup) ________________ test_rabbitmq_sharding_between_queues_publish _________________ rabbitmq_cluster = def test_rabbitmq_sharding_between_queues_publish(rabbitmq_cluster): NUM_CONSUMERS = 10 NUM_QUEUES = 10 logging.getLogger("pika").propagate = False instance.query( """ CREATE TABLE test.rabbitmq (key UInt64, value UInt64) ENGINE = RabbitMQ SETTINGS rabbitmq_host_port = 'rabbitmq1:5672', rabbitmq_exchange_name = 'test_sharding', rabbitmq_num_queues = 5, rabbitmq_num_consumers = 10, rabbitmq_max_block_size = 100, rabbitmq_flush_interval_ms=500, rabbitmq_format = 'JSONEachRow', rabbitmq_row_delimiter = '\\n'; CREATE TABLE test.view (key UInt64, value UInt64, channel_id String) ENGINE = MergeTree ORDER BY key SETTINGS old_parts_lifetime=5, cleanup_delay_period=2, cleanup_delay_period_random_add=3, cleanup_thread_preferred_points_per_iteration=0; CREATE MATERIALIZED VIEW test.consumer TO test.view AS SELECT *, _channel_id AS channel_id FROM test.rabbitmq; """ ) i = [0] messages_num = 10000 credentials = pika.PlainCredentials("root", "clickhouse") parameters = pika.ConnectionParameters( rabbitmq_cluster.rabbitmq_ip, rabbitmq_cluster.rabbitmq_port, "/", credentials ) def produce(): connection = pika.BlockingConnection(parameters) channel = connection.channel() messages = [] for _ in range(messages_num): messages.append(json.dumps({"key": i[0], "value": i[0]})) i[0] += 1 current = 0 for message in messages: current += 1 mes_id = str(current) channel.basic_publish( exchange="test_sharding", routing_key="", properties=pika.BasicProperties(message_id=mes_id), body=message, ) connection.close() threads = [] threads_num = 10 for _ in range(threads_num): threads.append(threading.Thread(target=produce)) for thread in threads: time.sleep(random.uniform(0, 1)) thread.start() result1 = "" deadline = time.monotonic() + DEFAULT_TIMEOUT_SEC expected = messages_num * threads_num while time.monotonic() < deadline: result1 = instance.query("SELECT count() FROM test.view") time.sleep(1) if int(result1) == expected: break logging.debug(f"Result {result1} / {expected}") else: > pytest.fail( f"Time limit of {DEFAULT_TIMEOUT_SEC} seconds reached. The result did not match the expected value." ) E Failed: Time limit of 60 seconds reached. The result did not match the expected value. test_storage_rabbitmq/test.py:768: Failed ------------------------------ Captured log setup ------------------------------ 2025-04-02 03:07:26 [ 600 ] INFO : Running tests in /ClickHouse/tests/integration/test_storage_rabbitmq/test.py (cluster.py:2677, start) 2025-04-02 03:07:26 [ 600 ] DEBUG : Cluster start called. is_up=False (cluster.py:2684, start) 2025-04-02 03:07:26 [ 600 ] DEBUG : Docker networks for project rootteststoragerabbitmq are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2025-04-02 03:07:26 [ 600 ] DEBUG : Docker containers for project rootteststoragerabbitmq are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2025-04-02 03:07:26 [ 600 ] DEBUG : Docker volumes for project rootteststoragerabbitmq are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2025-04-02 03:07:26 [ 600 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2025-04-02 03:07:26 [ 600 ] DEBUG : Docker networks for project rootteststoragerabbitmq are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2025-04-02 03:07:26 [ 600 ] DEBUG : Docker containers for project rootteststoragerabbitmq are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2025-04-02 03:07:26 [ 600 ] DEBUG : Docker volumes for project rootteststoragerabbitmq are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2025-04-02 03:07:26 [ 600 ] DEBUG : Command:[docker container list --all --filter name='^/rootteststoragerabbitmq-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:120, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2025-04-02 03:07:26 [ 600 ] DEBUG : No running containers for project: rootteststoragerabbitmq (cluster.py:904, cleanup) 2025-04-02 03:07:26 [ 600 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2025-04-02 03:07:26 [ 600 ] DEBUG : Trying to prune unused images... (cluster.py:926, cleanup) 2025-04-02 03:07:26 [ 600 ] DEBUG : Command:[docker image prune -f] (cluster.py:120, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:144, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Images pruned (cluster.py:929, cleanup) 2025-04-02 03:07:26 [ 600 ] DEBUG : Trying to prune unused volumes... (cluster.py:935, cleanup) 2025-04-02 03:07:26 [ 600 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:120, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Stdout:1 (cluster.py:144, run_and_check) 2025-04-02 03:07:26 [ 600 ] DEBUG : Volumes pruned: 1 (cluster.py:940, cleanup) 2025-04-02 03:07:26 [ 600 ] DEBUG : Setup directory for instance: instance (cluster.py:2697, start) 2025-04-02 03:07:26 [ 600 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4530, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Create directory for common tests configuration (cluster.py:4535, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Copy common configuration from helpers (cluster.py:4555, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Generate and write macros file (cluster.py:4607, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_storage_rabbitmq/configs/rabbitmq.xml', '/ClickHouse/tests/integration/test_storage_rabbitmq/configs/macros.xml', '/ClickHouse/tests/integration/test_storage_rabbitmq/configs/named_collection.xml'] to /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance/configs/config.d (cluster.py:4643, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance/database (cluster.py:4660, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance/logs (cluster.py:4671, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" (cluster.py:4752, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Setup directory for instance: instance2 (cluster.py:2697, start) 2025-04-02 03:07:26 [ 600 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4530, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Create directory for common tests configuration (cluster.py:4535, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Copy common configuration from helpers (cluster.py:4555, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Generate and write macros file (cluster.py:4607, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Copy custom test config files [] to /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance2/configs/config.d (cluster.py:4643, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance2/database (cluster.py:4660, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance2/logs (cluster.py:4671, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4752, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Setup directory for instance: instance3 (cluster.py:2697, start) 2025-04-02 03:07:26 [ 600 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4530, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Create directory for common tests configuration (cluster.py:4535, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Copy common configuration from helpers (cluster.py:4555, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Generate and write macros file (cluster.py:4607, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_storage_rabbitmq/configs/rabbitmq.xml', '/ClickHouse/tests/integration/test_storage_rabbitmq/configs/macros.xml', '/ClickHouse/tests/integration/test_storage_rabbitmq/configs/named_collection.xml', '/ClickHouse/tests/integration/test_storage_rabbitmq/configs/mergetree.xml'] to /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance3/configs/config.d (cluster.py:4643, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance3/database (cluster.py:4660, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance3/logs (cluster.py:4671, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon -- ; coproc tail -f /dev/null; wait $$!" (cluster.py:4752, create_dir) 2025-04-02 03:07:26 [ 600 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'RABBITMQ_HOST': 'rabbitmq1', 'RABBITMQ_PORT': '5672', 'RABBITMQ_SECURE_PORT': '5671', 'RABBITMQ_LOGS': '/ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/rabbitmq/logs', 'RABBITMQ_LOGS_FS': 'bind', 'RABBITMQ_COOKIE_FILE': '/ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/rabbitmq/erlang.cookie', 'RABBITMQ_COOKIE_FILE_FS': 'bind'} stored in /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/.env (cluster.py:95, _create_env_file) 2025-04-02 03:07:26 [ 600 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-04-02 03:07:26 [ 600 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-04-02 03:07:26 [ 600 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-04-02 03:07:26 [ 600 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-04-02 03:07:26 [ 600 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:547, _make_request) 2025-04-02 03:07:26 [ 600 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/.env --project-name rootteststoragerabbitmq --file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_rabbitmq.yml --file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance2/docker-compose.yml --file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance3/docker-compose.yml pull] (cluster.py:120, run_and_check) 2025-04-02 03:07:37 [ 600 ] DEBUG : Stderr: instance Skipped - Image is already being pulled by instance3 (cluster.py:146, run_and_check) 2025-04-02 03:07:37 [ 600 ] DEBUG : Stderr: instance2 Skipped - Image is already being pulled by instance3 (cluster.py:146, run_and_check) 2025-04-02 03:07:37 [ 600 ] DEBUG : Stderr: rabbitmq1 Pulling (cluster.py:146, run_and_check) 2025-04-02 03:07:37 [ 600 ] DEBUG : Stderr: instance3 Pulling (cluster.py:146, run_and_check) 2025-04-02 03:07:37 [ 600 ] DEBUG : Stderr: rabbitmq1 Pulled (cluster.py:146, run_and_check) 2025-04-02 03:07:37 [ 600 ] DEBUG : Stderr: instance3 Pulled (cluster.py:146, run_and_check) 2025-04-02 03:07:37 [ 600 ] DEBUG : Setup RabbitMQ (cluster.py:2909, start) 2025-04-02 03:07:37 [ 600 ] DEBUG : Command:[docker compose --project-name rootteststoragerabbitmq --env-file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_rabbitmq.yml --verbose up -d --renew-anon-volumes] (cluster.py:120, run_and_check) 2025-04-02 03:07:38 [ 600 ] DEBUG : Stderr:time="2025-04-02T03:07:37Z" level=trace msg="Docker Desktop integration not enabled" (cluster.py:146, run_and_check) 2025-04-02 03:07:38 [ 600 ] DEBUG : Stderr: Network rootteststoragerabbitmq_default Creating (cluster.py:146, run_and_check) 2025-04-02 03:07:38 [ 600 ] DEBUG : Stderr: Network rootteststoragerabbitmq_default Created (cluster.py:146, run_and_check) 2025-04-02 03:07:38 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-rabbitmq1-1 Creating (cluster.py:146, run_and_check) 2025-04-02 03:07:38 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-rabbitmq1-1 Created (cluster.py:146, run_and_check) 2025-04-02 03:07:38 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-rabbitmq1-1 Starting (cluster.py:146, run_and_check) 2025-04-02 03:07:38 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-rabbitmq1-1 Started (cluster.py:146, run_and_check) 2025-04-02 03:07:38 [ 600 ] DEBUG : Stderr:time="2025-04-02T03:07:38Z" level=debug msg="otel error" error="" (cluster.py:146, run_and_check) 2025-04-02 03:07:38 [ 600 ] DEBUG : Stderr:time="2025-04-02T03:07:38Z" level=debug msg="otel error" error="" (cluster.py:146, run_and_check) 2025-04-02 03:07:40 [ 600 ] DEBUG : RabbitMQ checking container try (cluster.py:2923, start) 2025-04-02 03:07:40 [ 600 ] DEBUG : Docker networks for project rootteststoragerabbitmq are NETWORK ID NAME DRIVER SCOPE fb1adf71a4bb rootteststoragerabbitmq_default bridge local (cluster.py:855, print_all_docker_pieces) 2025-04-02 03:07:40 [ 600 ] DEBUG : Docker containers for project rootteststoragerabbitmq are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 9e9c7e83b405 rabbitmq:4.0.4-alpine "docker-entrypoint.s…" 3 seconds ago Up 2 seconds (health: starting) 4369/tcp, 5671-5672/tcp, 15691-15692/tcp, 25672/tcp rootteststoragerabbitmq-rabbitmq1-1 (cluster.py:863, print_all_docker_pieces) 2025-04-02 03:07:40 [ 600 ] DEBUG : Docker volumes for project rootteststoragerabbitmq are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2025-04-02 03:07:40 [ 600 ] DEBUG : get_instance_ip instance_name=rabbitmq1 (cluster.py:2004, get_instance_ip) 2025-04-02 03:07:40 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragerabbitmq-rabbitmq1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:44 [ 600 ] DEBUG : RabbitMQ is available (cluster.py:2364, wait_rabbitmq_to_start) 2025-04-02 03:07:44 [ 600 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/.env --project-name rootteststoragerabbitmq --file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_rabbitmq.yml --file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance2/docker-compose.yml --file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance3/docker-compose.yml up -d --no-recreate') (cluster.py:3066, start) 2025-04-02 03:07:44 [ 600 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/.env --project-name rootteststoragerabbitmq --file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_rabbitmq.yml --file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance2/docker-compose.yml --file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance3/docker-compose.yml up -d --no-recreate] (cluster.py:120, run_and_check) 2025-04-02 03:07:44 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-rabbitmq1-1 Running (cluster.py:146, run_and_check) 2025-04-02 03:07:44 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance-1 Creating (cluster.py:146, run_and_check) 2025-04-02 03:07:44 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance2-1 Creating (cluster.py:146, run_and_check) 2025-04-02 03:07:44 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance3-1 Creating (cluster.py:146, run_and_check) 2025-04-02 03:07:44 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance3-1 Created (cluster.py:146, run_and_check) 2025-04-02 03:07:44 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance2-1 Created (cluster.py:146, run_and_check) 2025-04-02 03:07:44 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance-1 Created (cluster.py:146, run_and_check) 2025-04-02 03:07:44 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance-1 Starting (cluster.py:146, run_and_check) 2025-04-02 03:07:44 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance2-1 Starting (cluster.py:146, run_and_check) 2025-04-02 03:07:44 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance3-1 Starting (cluster.py:146, run_and_check) 2025-04-02 03:07:44 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance-1 Started (cluster.py:146, run_and_check) 2025-04-02 03:07:44 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance3-1 Started (cluster.py:146, run_and_check) 2025-04-02 03:07:44 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance2-1 Started (cluster.py:146, run_and_check) 2025-04-02 03:07:44 [ 600 ] DEBUG : ClickHouse instance created (cluster.py:3074, start) 2025-04-02 03:07:44 [ 600 ] DEBUG : get_instance_ip instance_name=instance (cluster.py:2004, get_instance_ip) 2025-04-02 03:07:44 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragerabbitmq-instance-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:44 [ 600 ] DEBUG : get_instance_ip instance_name=instance (cluster.py:2014, get_instance_global_ipv6) 2025-04-02 03:07:44 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragerabbitmq-instance-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:44 [ 600 ] DEBUG : Waiting for ClickHouse start in instance, ip: 172.16.1.3... (cluster.py:3082, start) 2025-04-02 03:07:44 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragerabbitmq-instance-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:44 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:45 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:45 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:45 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:45 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:45 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:45 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:45 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:45 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:45 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/a90badcc040b8b6238dec613c0eb8c351468322b811581f0d7584c0b22ce9b05/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : ClickHouse instance started (cluster.py:3086, start) 2025-04-02 03:07:46 [ 600 ] DEBUG : get_instance_ip instance_name=instance2 (cluster.py:2004, get_instance_ip) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragerabbitmq-instance2-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : get_instance_ip instance_name=instance2 (cluster.py:2014, get_instance_global_ipv6) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragerabbitmq-instance2-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : Waiting for ClickHouse start in instance2, ip: 172.16.1.4... (cluster.py:3082, start) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragerabbitmq-instance2-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/8ade8e9634aa87e4b9f3545a45e840c8d8f5f124b7a066806766894a7392e609/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : ClickHouse instance2 started (cluster.py:3086, start) 2025-04-02 03:07:46 [ 600 ] DEBUG : get_instance_ip instance_name=instance3 (cluster.py:2004, get_instance_ip) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragerabbitmq-instance3-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : get_instance_ip instance_name=instance3 (cluster.py:2014, get_instance_global_ipv6) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragerabbitmq-instance3-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : Waiting for ClickHouse start in instance3, ip: 172.16.1.5... (cluster.py:3082, start) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/rootteststoragerabbitmq-instance3-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/df354496da39bdabcc6d536e67c3cbfb3eeb1c0e3e026e95370b9fd24934b3ff/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : http://localhost:None "GET /v1.46/containers/df354496da39bdabcc6d536e67c3cbfb3eeb1c0e3e026e95370b9fd24934b3ff/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-02 03:07:46 [ 600 ] DEBUG : ClickHouse instance3 started (cluster.py:3086, start) 2025-04-02 03:07:46 [ 600 ] DEBUG : rabbitmq_id is rootteststoragerabbitmq-rabbitmq1-1 (test.py:113, rabbitmq_cluster) 2025-04-02 03:07:46 [ 600 ] DEBUG : Executing query CREATE DATABASE test on instance (cluster.py:3564, query) 2025-04-02 03:07:47 [ 600 ] DEBUG : Executing query CREATE DATABASE test on instance3 (cluster.py:3564, query) 2025-04-02 03:07:47 [ 600 ] DEBUG : RabbitMQ is available - running test (test.py:125, rabbitmq_setup_teardown) ------------------------------ Captured log call ------------------------------- 2025-04-02 03:07:47 [ 600 ] DEBUG : Executing query CREATE TABLE test.rabbitmq (key UInt64, value UInt64) ENGINE = RabbitMQ SETTINGS rabbitmq_host_port = 'rabbitmq1:5672', rabbitmq_exchange_name = 'test_sharding', rabbitmq_num_queues = 5, rabbitmq_num_consumers = 10, rabbitmq_max_block_size = 100, rabbitmq_flush_interval_ms=500, rabbitmq_format = 'JSONEachRow', rabbitmq_row_delimiter = '\n'; CREATE TABLE test.view (key UInt64, value UInt64, channel_id String) ENGINE = MergeTree ORDER BY key SETTINGS old_parts_lifetime=5, cleanup_delay_period=2, cleanup_delay_period_random_add=3, cleanup_thread_preferred_points_per_iteration=0; CREATE MATERIALIZED VIEW test.consumer TO test.view AS SELECT *, _channel_id AS channel_id FROM test.rabbitmq; on instance (cluster.py:3564, query) 2025-04-02 03:07:54 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:07:55 [ 600 ] DEBUG : Result 5563 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:07:55 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:07:57 [ 600 ] DEBUG : Result 6552 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:07:57 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:07:58 [ 600 ] DEBUG : Result 7874 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:07:58 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:07:59 [ 600 ] DEBUG : Result 8653 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:07:59 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:01 [ 600 ] DEBUG : Result 9189 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:01 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:02 [ 600 ] DEBUG : Result 9581 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:02 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:04 [ 600 ] DEBUG : Result 9784 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:04 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:05 [ 600 ] DEBUG : Result 10373 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:05 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:06 [ 600 ] DEBUG : Result 10758 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:06 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:08 [ 600 ] DEBUG : Result 11197 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:08 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:09 [ 600 ] DEBUG : Result 11403 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:09 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:10 [ 600 ] DEBUG : Result 12154 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:10 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:12 [ 600 ] DEBUG : Result 12990 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:12 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:13 [ 600 ] DEBUG : Result 13285 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:13 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:15 [ 600 ] DEBUG : Result 13487 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:15 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:16 [ 600 ] DEBUG : Result 13812 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:16 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:18 [ 600 ] DEBUG : Result 14011 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:18 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:19 [ 600 ] DEBUG : Result 14683 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:19 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:20 [ 600 ] DEBUG : Result 15702 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:20 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:22 [ 600 ] DEBUG : Result 16073 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:22 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:23 [ 600 ] DEBUG : Result 16270 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:23 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:24 [ 600 ] DEBUG : Result 16485 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:24 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:26 [ 600 ] DEBUG : Result 16784 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:26 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:27 [ 600 ] DEBUG : Result 16993 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:27 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:29 [ 600 ] DEBUG : Result 17402 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:29 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:30 [ 600 ] DEBUG : Result 17604 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:30 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:31 [ 600 ] DEBUG : Result 17899 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:31 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:33 [ 600 ] DEBUG : Result 18091 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:33 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:34 [ 600 ] DEBUG : Result 19433 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:34 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:35 [ 600 ] DEBUG : Result 20538 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:35 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:37 [ 600 ] DEBUG : Result 21087 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:37 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:38 [ 600 ] DEBUG : Result 21291 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:38 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:40 [ 600 ] DEBUG : Result 21498 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:40 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:41 [ 600 ] DEBUG : Result 21805 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:41 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:42 [ 600 ] DEBUG : Result 22000 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:42 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:44 [ 600 ] DEBUG : Result 22208 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:44 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:45 [ 600 ] DEBUG : Result 22504 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:45 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:46 [ 600 ] DEBUG : Result 22714 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:46 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:48 [ 600 ] DEBUG : Result 23006 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:48 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:49 [ 600 ] DEBUG : Result 23229 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:49 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:50 [ 600 ] DEBUG : Result 23442 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:50 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:52 [ 600 ] DEBUG : Result 33436 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:52 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:53 [ 600 ] DEBUG : Result 45136 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) 2025-04-02 03:08:53 [ 600 ] DEBUG : Executing query SELECT count() FROM test.view on instance (cluster.py:3564, query) 2025-04-02 03:08:54 [ 600 ] DEBUG : Result 57736 / 100000 (test.py:766, test_rabbitmq_sharding_between_queues_publish) ---------------------------- Captured log teardown ----------------------------- 2025-04-02 03:08:54 [ 600 ] DEBUG : Executing query DROP DATABASE test SYNC on instance (cluster.py:3564, query) 2025-04-02 03:08:55 [ 600 ] DEBUG : Executing query CREATE DATABASE test on instance (cluster.py:3564, query) 2025-04-02 03:08:55 [ 600 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/.env --project-name rootteststoragerabbitmq --file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_rabbitmq.yml --file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance2/docker-compose.yml --file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance3/docker-compose.yml stop --timeout 20] (cluster.py:120, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance2-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance3-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance3-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance2-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-rabbitmq1-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-rabbitmq1-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:120, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:120, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance3/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance3/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:120, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/.env --project-name rootteststoragerabbitmq --file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_rabbitmq.yml --file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance2/docker-compose.yml --file /ClickHouse/tests/integration/test_storage_rabbitmq/_instances-1/instance3/docker-compose.yml down --volumes] (cluster.py:120, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance2-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance3-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance2-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance2-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance3-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance3-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance3-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance2-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-instance-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-rabbitmq1-1 Stopping (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-rabbitmq1-1 Stopped (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-rabbitmq1-1 Removing (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Container rootteststoragerabbitmq-rabbitmq1-1 Removed (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Network rootteststoragerabbitmq_default Removing (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Stderr: Network rootteststoragerabbitmq_default Removed (cluster.py:146, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2025-04-02 03:09:01 [ 600 ] DEBUG : Docker networks for project rootteststoragerabbitmq are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2025-04-02 03:09:01 [ 600 ] DEBUG : Docker containers for project rootteststoragerabbitmq are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2025-04-02 03:09:01 [ 600 ] DEBUG : Docker volumes for project rootteststoragerabbitmq are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2025-04-02 03:09:01 [ 600 ] DEBUG : Command:[docker container list --all --filter name='^/rootteststoragerabbitmq-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:120, run_and_check) 2025-04-02 03:09:01 [ 600 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2025-04-02 03:09:01 [ 600 ] DEBUG : No running containers for project: rootteststoragerabbitmq (cluster.py:904, cleanup) 2025-04-02 03:09:01 [ 600 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2025-04-02 03:09:02 [ 600 ] DEBUG : Trying to prune unused images... (cluster.py:926, cleanup) 2025-04-02 03:09:02 [ 600 ] DEBUG : Command:[docker image prune -f] (cluster.py:120, run_and_check) 2025-04-02 03:09:02 [ 600 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:144, run_and_check) 2025-04-02 03:09:02 [ 600 ] DEBUG : Images pruned (cluster.py:929, cleanup) 2025-04-02 03:09:02 [ 600 ] DEBUG : Trying to prune unused volumes... (cluster.py:935, cleanup) 2025-04-02 03:09:02 [ 600 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:120, run_and_check) 2025-04-02 03:09:02 [ 600 ] DEBUG : Stdout:1 (cluster.py:144, run_and_check) 2025-04-02 03:09:02 [ 600 ] DEBUG : Volumes pruned: 1 (cluster.py:940, cleanup) ============================== slowest durations =============================== 95.66s call test_storage_delta/test.py::test_checkpoint[0] 74.86s call test_storage_delta/test.py::test_checkpoint[1] 67.45s call test_storage_rabbitmq/test.py::test_rabbitmq_sharding_between_queues_publish 29.65s call test_storage_delta/test.py::test_partition_columns[0] 27.89s call test_storage_delta/test.py::test_partition_columns[1] 27.51s setup test_storage_delta/test.py::test_checkpoint[0] 21.75s teardown test_storage_delta/test.py::test_types[1] 21.07s setup test_storage_rabbitmq/test.py::test_rabbitmq_sharding_between_queues_publish 7.11s teardown test_storage_rabbitmq/test.py::test_rabbitmq_sharding_between_queues_publish 5.46s call test_storage_delta/test.py::test_types[1] 5.37s call test_storage_delta/test.py::test_types[0] 3.72s call test_storage_delta/test.py::test_partition_by[0] 3.69s call test_storage_delta/test.py::test_filesystem_cache[0-s3] 3.62s call test_storage_delta/test.py::test_restart_broken[1] 3.48s call test_storage_delta/test.py::test_restart_broken_table_function[0] 3.48s call test_storage_delta/test.py::test_partition_by[1] 3.44s call test_storage_delta/test.py::test_restart_broken_table_function[1] 3.42s call test_storage_delta/test.py::test_metadata[0] 3.41s call test_storage_delta/test.py::test_filesystem_cache[1-s3] 3.35s call test_storage_delta/test.py::test_metadata[1] 3.34s call test_storage_delta/test.py::test_single_log_file[1] 3.30s call test_storage_delta/test.py::test_restart_broken[0] 3.28s call test_storage_delta/test.py::test_single_log_file[0] 3.15s call test_storage_delta/test.py::test_multiple_log_files[0] 3.02s call test_storage_delta/test.py::test_multiple_log_files[1] 1.83s call test_storage_delta/test.py::test_replicated_database_and_unavailable_s3[0] 1.60s call test_storage_delta/test.py::test_replicated_database_and_unavailable_s3[1] 0.50s call test_storage_delta/test.py::test_complex_types[0] 0.41s call test_storage_delta/test.py::test_complex_types[1] 0.01s teardown test_storage_delta/test.py::test_checkpoint[1] 0.00s teardown test_storage_delta/test.py::test_checkpoint[0] 0.00s teardown test_storage_delta/test.py::test_partition_columns[1] 0.00s teardown test_storage_delta/test.py::test_partition_columns[0] 0.00s teardown test_storage_delta/test.py::test_partition_by[1] 0.00s teardown test_storage_delta/test.py::test_types[0] 0.00s teardown test_storage_delta/test.py::test_partition_by[0] 0.00s setup test_storage_delta/test.py::test_restart_broken_table_function[0] 0.00s teardown test_storage_delta/test.py::test_multiple_log_files[0] 0.00s teardown test_storage_delta/test.py::test_restart_broken[1] 0.00s teardown test_storage_delta/test.py::test_restart_broken_table_function[1] 0.00s teardown test_storage_delta/test.py::test_multiple_log_files[1] 0.00s setup test_storage_delta/test.py::test_complex_types[0] 0.00s teardown test_storage_delta/test.py::test_single_log_file[0] 0.00s teardown test_storage_delta/test.py::test_restart_broken[0] 0.00s setup test_storage_delta/test.py::test_single_log_file[1] 0.00s setup test_storage_delta/test.py::test_filesystem_cache[0-s3] 0.00s teardown test_storage_delta/test.py::test_filesystem_cache[1-s3] 0.00s setup test_storage_delta/test.py::test_replicated_database_and_unavailable_s3[0] 0.00s teardown test_storage_delta/test.py::test_complex_types[0] 0.00s teardown test_storage_delta/test.py::test_replicated_database_and_unavailable_s3[1] 0.00s teardown test_storage_delta/test.py::test_filesystem_cache[0-s3] 0.00s teardown test_storage_delta/test.py::test_single_log_file[1] 0.00s teardown test_storage_delta/test.py::test_replicated_database_and_unavailable_s3[0] 0.00s setup test_storage_delta/test.py::test_multiple_log_files[1] 0.00s setup test_storage_delta/test.py::test_filesystem_cache[1-s3] 0.00s setup test_storage_delta/test.py::test_partition_by[1] 0.00s teardown test_storage_delta/test.py::test_restart_broken_table_function[0] 0.00s setup test_storage_delta/test.py::test_types[1] 0.00s setup test_storage_delta/test.py::test_restart_broken[0] 0.00s setup test_storage_delta/test.py::test_metadata[0] 0.00s setup test_storage_delta/test.py::test_metadata[1] 0.00s setup test_storage_delta/test.py::test_partition_columns[1] 0.00s teardown test_storage_delta/test.py::test_metadata[0] 0.00s setup test_storage_delta/test.py::test_checkpoint[1] 0.00s setup test_storage_delta/test.py::test_single_log_file[0] 0.00s setup test_storage_delta/test.py::test_types[0] 0.00s teardown test_storage_delta/test.py::test_complex_types[1] 0.00s teardown test_storage_delta/test.py::test_metadata[1] 0.00s setup test_storage_delta/test.py::test_restart_broken_table_function[1] 0.00s setup test_storage_delta/test.py::test_partition_columns[0] 0.00s setup test_storage_delta/test.py::test_multiple_log_files[0] 0.00s setup test_storage_delta/test.py::test_complex_types[1] 0.00s setup test_storage_delta/test.py::test_restart_broken[1] 0.00s setup test_storage_delta/test.py::test_replicated_database_and_unavailable_s3[1] 0.00s setup test_storage_delta/test.py::test_partition_by[0] =========================== short test summary info ============================ FAILED test_storage_delta/test.py::test_checkpoint[0] - helpers.client.QueryR... FAILED test_storage_delta/test.py::test_checkpoint[1] - helpers.client.QueryR... FAILED test_storage_delta/test.py::test_complex_types[0] - helpers.client.Que... FAILED test_storage_delta/test.py::test_complex_types[1] - helpers.client.Que... FAILED test_storage_delta/test.py::test_filesystem_cache[0-s3] - helpers.clie... FAILED test_storage_delta/test.py::test_filesystem_cache[1-s3] - helpers.clie... FAILED test_storage_delta/test.py::test_metadata[0] - helpers.client.QueryRun... FAILED test_storage_delta/test.py::test_metadata[1] - helpers.client.QueryRun... FAILED test_storage_delta/test.py::test_multiple_log_files[0] - helpers.clien... FAILED test_storage_delta/test.py::test_multiple_log_files[1] - helpers.clien... FAILED test_storage_delta/test.py::test_partition_by[0] - helpers.client.Quer... FAILED test_storage_delta/test.py::test_partition_by[1] - helpers.client.Quer... FAILED test_storage_delta/test.py::test_partition_columns[0] - helpers.client... FAILED test_storage_delta/test.py::test_partition_columns[1] - helpers.client... FAILED test_storage_delta/test.py::test_replicated_database_and_unavailable_s3[0] FAILED test_storage_delta/test.py::test_replicated_database_and_unavailable_s3[1] FAILED test_storage_delta/test.py::test_restart_broken[0] - helpers.client.Qu... FAILED test_storage_delta/test.py::test_restart_broken[1] - helpers.client.Qu... FAILED test_storage_delta/test.py::test_restart_broken_table_function[0] - he... FAILED test_storage_delta/test.py::test_restart_broken_table_function[1] - he... FAILED test_storage_delta/test.py::test_single_log_file[0] - helpers.client.Q... FAILED test_storage_delta/test.py::test_single_log_file[1] - helpers.client.Q... FAILED test_storage_delta/test.py::test_types[0] - helpers.client.QueryRuntim... FAILED test_storage_delta/test.py::test_types[1] - helpers.client.QueryRuntim... FAILED test_storage_rabbitmq/test.py::test_rabbitmq_sharding_between_queues_publish ======================== 25 failed in 440.70s (0:07:20) ======================== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 528, in subprocess.check_call(cmd, shell=True, bufsize=0) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_esx477 --privileged --dns-search='.' --memory=30709035008 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=8b2301119731 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS=" -rfEps --run-id=1 --color=no --durations=0 'test_storage_delta/test.py::test_checkpoint[0]' 'test_storage_delta/test.py::test_checkpoint[1]' 'test_storage_delta/test.py::test_complex_types[0]' 'test_storage_delta/test.py::test_complex_types[1]' 'test_storage_delta/test.py::test_filesystem_cache[0-s3]' 'test_storage_delta/test.py::test_filesystem_cache[1-s3]' 'test_storage_delta/test.py::test_metadata[0]' 'test_storage_delta/test.py::test_metadata[1]' 'test_storage_delta/test.py::test_multiple_log_files[0]' 'test_storage_delta/test.py::test_multiple_log_files[1]' 'test_storage_delta/test.py::test_partition_by[0]' 'test_storage_delta/test.py::test_partition_by[1]' 'test_storage_delta/test.py::test_partition_columns[0]' 'test_storage_delta/test.py::test_partition_columns[1]' 'test_storage_delta/test.py::test_replicated_database_and_unavailable_s3[0]' 'test_storage_delta/test.py::test_replicated_database_and_unavailable_s3[1]' 'test_storage_delta/test.py::test_restart_broken[0]' 'test_storage_delta/test.py::test_restart_broken[1]' 'test_storage_delta/test.py::test_restart_broken_table_function[0]' 'test_storage_delta/test.py::test_restart_broken_table_function[1]' 'test_storage_delta/test.py::test_single_log_file[0]' 'test_storage_delta/test.py::test_single_log_file[1]' 'test_storage_delta/test.py::test_types[0]' 'test_storage_delta/test.py::test_types[1]' test_storage_rabbitmq/test.py::test_rabbitmq_sharding_between_queues_publish -vvv -ss" altinityinfra/integration-tests-runner:2165613c5fcd ' returned non-zero exit status 1.